[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:53 dist-test-slave-77v9 krb5kdc[9599](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:53 dist-test-slave-77v9 krb5kdc[9599](info): set up 2 sockets
Aug 08 07:06:53 dist-test-slave-77v9 krb5kdc[9599](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 07:06:55.020694 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:06:55 dist-test-slave-77v9 krb5kdc[9599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:06:55.185458 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:39691
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:43317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:39691
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:55.295912 9612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:55.296165 9612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:55.296193 9612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:55.297587 9612 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:55.297639 9612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:55.297655 9612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:55.297668 9612 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:55.297681 9612 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:55.299486 9612 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:39691
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:39691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:06:55.299721 9612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:55.300135 9612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:55.307933 9619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:55.308012 9621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:55.308086 9618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:55.308043 9612 server_base.cc:1034] running on GCE node
I20260808 07:06:55.308741 9612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:55.309149 9612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:55.310371 9612 hybrid_clock.cc:648] HybridClock initialized: now 1786172815310364 us; error 40 us; skew 500 ppm
Aug 08 07:06:55 dist-test-slave-77v9 krb5kdc[9599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172815, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:55.314661 9612 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:06:55.315425 9612 webserver.cc:460] Webserver started at http://127.9.94.62:33613/ using document root <none> and password file <none>
I20260808 07:06:55.315727 9612 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:55.315814 9612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:55.315986 9612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:55.317535 9612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "ac9f98f237014000bd4b26980de47cda"
format_stamp: "Formatted at 2026-08-08 07:06:55 on dist-test-slave-77v9"
server_key: "538078b6c9c676a42d2cc269a882daf8"
server_key_iv: "22e8ad131c462f029109c623196689cd"
server_key_version: "encryptionkey@0"
I20260808 07:06:55.318035 9612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "ac9f98f237014000bd4b26980de47cda"
format_stamp: "Formatted at 2026-08-08 07:06:55 on dist-test-slave-77v9"
server_key: "538078b6c9c676a42d2cc269a882daf8"
server_key_iv: "22e8ad131c462f029109c623196689cd"
server_key_version: "encryptionkey@0"
I20260808 07:06:55.320236 9612 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260808 07:06:55.321462 9629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:55.322059 9612 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:06:55.322203 9612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "ac9f98f237014000bd4b26980de47cda"
format_stamp: "Formatted at 2026-08-08 07:06:55 on dist-test-slave-77v9"
server_key: "538078b6c9c676a42d2cc269a882daf8"
server_key_iv: "22e8ad131c462f029109c623196689cd"
server_key_version: "encryptionkey@0"
I20260808 07:06:55.322304 9612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:55.343849 9612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:55.347054 9612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:55.347325 9612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:55.354490 9612 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:39691
I20260808 07:06:55.354594 9681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:39691 every 8 connection(s)
I20260808 07:06:55.355189 9612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:55.356232 9682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:55.358845 9682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda: Bootstrap starting.
I20260808 07:06:55.359706 9682 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:55.360589 9682 log.cc:824] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:55.362103 9682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda: No bootstrap required, opened a new log
I20260808 07:06:55.363763 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 9612
I20260808 07:06:55.363945 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:06:55.364980 9592 external_mini_cluster.cc:1428] Setting key 79aa529ce3ec5c8e0706e84382a8f0d2
I20260808 07:06:55.367350 9682 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac9f98f237014000bd4b26980de47cda" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39691 } }
I20260808 07:06:55.367547 9682 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:55.367602 9682 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac9f98f237014000bd4b26980de47cda, State: Initialized, Role: FOLLOWER
I20260808 07:06:55.367784 9682 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac9f98f237014000bd4b26980de47cda" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39691 } }
I20260808 07:06:55.367899 9682 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:06:55.367949 9682 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:06:55.368002 9682 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:55.370131 9682 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac9f98f237014000bd4b26980de47cda" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39691 } }
I20260808 07:06:55.370301 9682 leader_election.cc:302] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac9f98f237014000bd4b26980de47cda; no voters:
I20260808 07:06:55.370581 9682 leader_election.cc:288] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:06:55.370611 9687 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:55.370731 9687 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [term 1 LEADER]: Becoming Leader. State: Replica: ac9f98f237014000bd4b26980de47cda, State: Running, Role: LEADER
I20260808 07:06:55.370810 9687 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac9f98f237014000bd4b26980de47cda" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39691 } }
I20260808 07:06:55.371068 9682 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:55.371596 9688 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac9f98f237014000bd4b26980de47cda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac9f98f237014000bd4b26980de47cda" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39691 } } }
I20260808 07:06:55.371802 9688 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:55.371577 9689 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac9f98f237014000bd4b26980de47cda. Latest consensus state: current_term: 1 leader_uuid: "ac9f98f237014000bd4b26980de47cda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac9f98f237014000bd4b26980de47cda" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39691 } } }
I20260808 07:06:55.372088 9689 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:55.372292 9692 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:55.373095 9692 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:06:55.375226 9692 catalog_manager.cc:1347] Generated new cluster ID: 4e9c39bba5b54ba199b33e4514844c3c
I20260808 07:06:55.375309 9692 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:06:55.382314 9692 catalog_manager.cc:1370] Generated new certificate authority record
Aug 08 07:06:55 dist-test-slave-77v9 krb5kdc[9599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:06:55.382891 9692 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:55.388351 9686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:55.366366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39574 (local address 127.9.94.62:39691)
0808 07:06:55.366748 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:55.366769 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:55.366984 (+ 215us) server_negotiation.cc:407] Connection header received
0808 07:06:55.370613 (+ 3629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:55.370618 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:55.371117 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:55.372036 (+ 919us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:55.374505 (+ 2469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:55.375911 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:55.377581 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:55.378261 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:55.378374 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:55.383345 (+ 4971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:55.383350 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:55.383350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:55.383365 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:55.385726 (+ 2361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:55.386291 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:55.386294 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:55.386295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:55.386424 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:55.386746 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:55.386747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:55.386747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:55.387080 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:55.387541 (+ 461us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:55.387872 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 07:06:55.388067 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":137,"threads_started":1}
I20260808 07:06:55.390349 9692 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac9f98f237014000bd4b26980de47cda: Generated new TSK 0
I20260808 07:06:55.390558 9692 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:06:55.438133 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39691
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:43317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:55.543619 9708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:55.543864 9708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:55.543890 9708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:55.545245 9708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:55.545295 9708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:55.545324 9708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:06:55.547721 9708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39691
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:06:55.548084 9708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:55.548379 9708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:55.555146 9714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:55.555146 9716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:55.555416 9713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:55.556905 9708 server_base.cc:1034] running on GCE node
I20260808 07:06:55.557219 9708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:55.557595 9708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:55.558866 9708 hybrid_clock.cc:648] HybridClock initialized: now 1786172815558838 us; error 45 us; skew 500 ppm
Aug 08 07:06:55 dist-test-slave-77v9 krb5kdc[9599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172815, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:55.562114 9708 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:06:55.563184 9708 webserver.cc:460] Webserver started at http://127.9.94.1:44403/ using document root <none> and password file <none>
I20260808 07:06:55.563578 9708 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:55.563668 9708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:55.563864 9708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:55.565759 9708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "8155d88c9a48489f8e19952068e4c837"
format_stamp: "Formatted at 2026-08-08 07:06:55 on dist-test-slave-77v9"
server_key: "6ec0621a30483077a5b5c209752d51df"
server_key_iv: "f0eb8aa2a519570236c558b733321b44"
server_key_version: "encryptionkey@0"
I20260808 07:06:55.567444 9708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "8155d88c9a48489f8e19952068e4c837"
format_stamp: "Formatted at 2026-08-08 07:06:55 on dist-test-slave-77v9"
server_key: "6ec0621a30483077a5b5c209752d51df"
server_key_iv: "f0eb8aa2a519570236c558b733321b44"
server_key_version: "encryptionkey@0"
I20260808 07:06:55.569324 9708 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 07:06:55.570490 9723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:55.570897 9708 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:55.571099 9708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "8155d88c9a48489f8e19952068e4c837"
format_stamp: "Formatted at 2026-08-08 07:06:55 on dist-test-slave-77v9"
server_key: "6ec0621a30483077a5b5c209752d51df"
server_key_iv: "f0eb8aa2a519570236c558b733321b44"
server_key_version: "encryptionkey@0"
I20260808 07:06:55.571174 9708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:55.581599 9708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:55.584954 9708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:55.585173 9708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:55.585521 9708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:55.585884 9708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:55.585923 9708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:55.585948 9708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:55.585963 9708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:55.594983 9708 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:36827
I20260808 07:06:55.595027 9837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:36827 every 8 connection(s)
I20260808 07:06:55.595415 9708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:06:55.596966 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 9708
I20260808 07:06:55.597056 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:06:55.597221 9592 external_mini_cluster.cc:1428] Setting key 44ea48301a621a5d8f9fe8235f077bf5
Aug 08 07:06:55 dist-test-slave-77v9 krb5kdc[9599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172815, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
I20260808 07:06:55.610846 9686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:55.596438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:57059 (local address 127.9.94.62:39691)
0808 07:06:55.596508 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:55.596510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:55.596764 (+ 254us) server_negotiation.cc:407] Connection header received
0808 07:06:55.597394 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:55.597396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:55.597409 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:55.597501 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:55.598939 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:55.599694 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:55.602047 (+ 2353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:55.602274 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:55.602350 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:55.606162 (+ 3812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:55.606165 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:55.606165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:55.606178 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:55.608744 (+ 2566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:55.609415 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:55.609416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:55.609417 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:55.609491 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:55.609884 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:55.609885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:55.609886 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:55.610212 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:55.610279 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:55.610684 (+ 405us) server_negotiation.cc:299] Negotiation successful
0808 07:06:55.610774 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 07:06:55.611147 9841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:55.596347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39691 (local address 127.9.94.1:57059)
0808 07:06:55.596531 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:55.596576 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:55.597288 (+ 712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:55.597584 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:55.597588 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:55.598492 (+ 904us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:55.598812 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:55.598819 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:55.599926 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:55.599929 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:55.601891 (+ 1962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:55.601898 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:55.602398 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:55.602399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:55.602576 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:55.603418 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:55.603429 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:55.606024 (+ 2595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:55.609010 (+ 2986us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:55.609020 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:55.609022 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:55.609300 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:55.609594 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:55.609595 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:55.609596 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:55.609734 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:55.610320 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:55.610327 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:55.610497 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 07:06:55.610613 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 07:06:55.610775 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":109,"threads_started":1}
I20260808 07:06:55.611877 9839 heartbeater.cc:347] Connected to a master server at 127.9.94.62:39691
I20260808 07:06:55.611994 9839 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:55.612162 9839 heartbeater.cc:511] Master 127.9.94.62:39691 requested a full tablet report, sending...
I20260808 07:06:55.612938 9646 ts_manager.cc:194] Registered new tserver with Master: 8155d88c9a48489f8e19952068e4c837 (127.9.94.1:36827)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
I20260808 07:06:55.613761 9646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:57059
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:06:55.637235 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39691
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:43317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:55.735453 9844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:55.735700 9844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:55.736011 9844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:55.738157 9844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:55.738238 9844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:55.738274 9844 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:06:55.740191 9844 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39691
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9844
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:06:55.740478 9844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:55.740753 9844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:55.747766 9849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:55.747663 9852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:55.747663 9850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:55.748202 9844 server_base.cc:1034] running on GCE node
I20260808 07:06:55.748456 9844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:55.748796 9844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:55.750095 9844 hybrid_clock.cc:648] HybridClock initialized: now 1786172815750045 us; error 88 us; skew 500 ppm
Aug 08 07:06:55 dist-test-slave-77v9 krb5kdc[9599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172815, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:55.753597 9844 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:06:55.754142 9844 webserver.cc:460] Webserver started at http://127.9.94.2:44117/ using document root <none> and password file <none>
I20260808 07:06:55.754402 9844 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:55.754489 9844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:55.754645 9844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:55.755795 9844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "9a2a736a05484d28871c4e089adabbbf"
format_stamp: "Formatted at 2026-08-08 07:06:55 on dist-test-slave-77v9"
server_key: "bc65fd2eada275e80305c989cefb7f07"
server_key_iv: "e6bf19aa6a52ea5aeb11b3d5c1e40f4c"
server_key_version: "encryptionkey@0"
I20260808 07:06:55.756299 9844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "9a2a736a05484d28871c4e089adabbbf"
format_stamp: "Formatted at 2026-08-08 07:06:55 on dist-test-slave-77v9"
server_key: "bc65fd2eada275e80305c989cefb7f07"
server_key_iv: "e6bf19aa6a52ea5aeb11b3d5c1e40f4c"
server_key_version: "encryptionkey@0"
I20260808 07:06:55.758117 9844 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260808 07:06:55.759357 9859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:55.759824 9844 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:06:55.760047 9844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "9a2a736a05484d28871c4e089adabbbf"
format_stamp: "Formatted at 2026-08-08 07:06:55 on dist-test-slave-77v9"
server_key: "bc65fd2eada275e80305c989cefb7f07"
server_key_iv: "e6bf19aa6a52ea5aeb11b3d5c1e40f4c"
server_key_version: "encryptionkey@0"
I20260808 07:06:55.760244 9844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:55.787503 9844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:55.790581 9844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:55.790795 9844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:55.791298 9844 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:55.791810 9844 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:55.792029 9844 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:55.792119 9844 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:55.792150 9844 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:55.799705 9844 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:35915
I20260808 07:06:55.799757 9978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:35915 every 8 connection(s)
I20260808 07:06:55.800202 9844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:06:55.804549 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 9844
I20260808 07:06:55.804651 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:06:55.804903 9592 external_mini_cluster.cc:1428] Setting key 964fd70487885fc2292fe3a3e4d1552d
Aug 08 07:06:55 dist-test-slave-77v9 krb5kdc[9599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172815, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:06:55.814647 9686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:55.801184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:55355 (local address 127.9.94.62:39691)
0808 07:06:55.801320 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:55.801323 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:55.801563 (+ 240us) server_negotiation.cc:407] Connection header received
0808 07:06:55.802194 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:55.802196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:55.802210 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:55.802268 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:55.803713 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:55.804222 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:55.805559 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:55.805798 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:55.805872 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:55.809861 (+ 3989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:55.809863 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:55.809863 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:55.809873 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:55.812412 (+ 2539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:55.813156 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:55.813157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:55.813158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:55.813234 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:55.813696 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:55.813699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:55.813699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:55.813916 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:55.814001 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:55.814460 (+ 459us) server_negotiation.cc:299] Negotiation successful
0808 07:06:55.814565 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 07:06:55.814869 9981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:55.801129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39691 (local address 127.9.94.2:55355)
0808 07:06:55.801375 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:55.801465 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:55.802056 (+ 591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:55.802343 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:55.802347 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:55.803373 (+ 1026us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:55.803586 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:55.803592 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:55.804334 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:55.804335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:55.805471 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:55.805474 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:55.805928 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:55.805930 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:55.806116 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:55.806954 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:55.806966 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:55.809640 (+ 2674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:55.812542 (+ 2902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:55.812572 (+ 30us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:55.812575 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:55.813032 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:55.813323 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:55.813323 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:55.813324 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:55.813502 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:55.814012 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:55.814020 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:55.814231 (+ 211us) client_negotiation.cc:769] Sending connection context
0808 07:06:55.814361 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 07:06:55.814602 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":105,"threads_started":1}
I20260808 07:06:55.815567 9979 heartbeater.cc:347] Connected to a master server at 127.9.94.62:39691
I20260808 07:06:55.815681 9979 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:55.815917 9979 heartbeater.cc:511] Master 127.9.94.62:39691 requested a full tablet report, sending...
I20260808 07:06:55.816498 9646 ts_manager.cc:194] Registered new tserver with Master: 9a2a736a05484d28871c4e089adabbbf (127.9.94.2:35915)
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
I20260808 07:06:55.817035 9646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:55355
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:06:55.846052 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39691
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:43317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:55.950088 9984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:55.950522 9984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:55.950625 9984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:55.951985 9984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:55.952072 9984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:55.952121 9984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:06:55.953846 9984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39691
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:06:55.954202 9984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:55.954707 9984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:55.961436 9991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:55.961532 9990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:55.961436 9993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:55.962534 9984 server_base.cc:1034] running on GCE node
I20260808 07:06:55.962891 9984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:55.963200 9984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:55.964416 9984 hybrid_clock.cc:648] HybridClock initialized: now 1786172815964403 us; error 62 us; skew 500 ppm
Aug 08 07:06:55 dist-test-slave-77v9 krb5kdc[9599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172815, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:55.967847 9984 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:06:55.968493 9984 webserver.cc:460] Webserver started at http://127.9.94.3:46645/ using document root <none> and password file <none>
I20260808 07:06:55.968777 9984 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:55.968894 9984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:55.969089 9984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:55.970343 9984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "24137feb323f4afeb75d33f8a32a6142"
format_stamp: "Formatted at 2026-08-08 07:06:55 on dist-test-slave-77v9"
server_key: "442a83df4bf421ac5b01e0f6a97216b7"
server_key_iv: "bf5843e76123b22c9ed1065661de8dc0"
server_key_version: "encryptionkey@0"
I20260808 07:06:55.970775 9984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "24137feb323f4afeb75d33f8a32a6142"
format_stamp: "Formatted at 2026-08-08 07:06:55 on dist-test-slave-77v9"
server_key: "442a83df4bf421ac5b01e0f6a97216b7"
server_key_iv: "bf5843e76123b22c9ed1065661de8dc0"
server_key_version: "encryptionkey@0"
I20260808 07:06:55.973124 9984 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260808 07:06:55.975072 10000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:55.975558 9984 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:06:55.975841 9984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "24137feb323f4afeb75d33f8a32a6142"
format_stamp: "Formatted at 2026-08-08 07:06:55 on dist-test-slave-77v9"
server_key: "442a83df4bf421ac5b01e0f6a97216b7"
server_key_iv: "bf5843e76123b22c9ed1065661de8dc0"
server_key_version: "encryptionkey@0"
I20260808 07:06:55.975960 9984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:56.002130 9984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:56.005450 9984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:56.005652 9984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:56.005950 9984 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:56.006299 9984 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:56.006356 9984 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:56.006410 9984 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:56.006453 9984 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:56.015486 9984 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:43541
I20260808 07:06:56.015530 10117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:43541 every 8 connection(s)
I20260808 07:06:56.015957 9984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:06:56 dist-test-slave-77v9 krb5kdc[9599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172815, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:06:56.024459 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 9984
I20260808 07:06:56.024572 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:06:56.024761 9592 external_mini_cluster.cc:1428] Setting key 6e00a9f561de0b86712bcadc83583c9d
I20260808 07:06:56.028060 9686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:56.016904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:50167 (local address 127.9.94.62:39691)
0808 07:06:56.017171 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:56.017174 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:56.017532 (+ 358us) server_negotiation.cc:407] Connection header received
0808 07:06:56.018174 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:56.018175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:56.018187 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:56.018256 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:56.019525 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:56.020082 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:56.021412 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:56.021617 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:56.021686 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:56.024340 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:56.024341 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:56.024342 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:56.024350 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:56.026073 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:56.026690 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:56.026693 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:56.026694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:56.026825 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:56.027289 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:56.027290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:56.027290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:56.027432 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:56.027509 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:56.027769 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 07:06:56.027903 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220}
I20260808 07:06:56.028079 10120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:56.016995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39691 (local address 127.9.94.3:50167)
0808 07:06:56.017331 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:56.017393 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:56.018018 (+ 625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:56.018400 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:56.018404 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:56.019164 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:56.019403 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:56.019409 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:56.020234 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:56.020235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:56.021309 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:56.021312 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:56.021743 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:56.021744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:56.021886 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:56.022450 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:56.022459 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:56.024151 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:56.026149 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:56.026156 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:56.026159 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:56.026415 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:56.027004 (+ 589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:56.027005 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:56.027006 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:56.027158 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:56.027508 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:56.027513 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:56.027643 (+ 130us) client_negotiation.cc:769] Sending connection context
0808 07:06:56.027736 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 07:06:56.027876 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":139,"threads_started":1}
I20260808 07:06:56.028708 10118 heartbeater.cc:347] Connected to a master server at 127.9.94.62:39691
I20260808 07:06:56.028898 10118 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:56.029098 10118 heartbeater.cc:511] Master 127.9.94.62:39691 requested a full tablet report, sending...
I20260808 07:06:56.029654 9646 ts_manager.cc:194] Registered new tserver with Master: 24137feb323f4afeb75d33f8a32a6142 (127.9.94.3:43541)
I20260808 07:06:56.030019 9646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:50167
I20260808 07:06:56.038192 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 07:06:56 dist-test-slave-77v9 krb5kdc[9599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172816, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 07:06:56 dist-test-slave-77v9 krb5kdc[9599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172816, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.94.1@KRBTEST.COM
I20260808 07:06:56.070358 10125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:56.059198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34258 (local address 127.9.94.1:36827)
0808 07:06:56.059425 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:56.059430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:56.059443 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:06:56.059555 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:56.059559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:56.059574 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:56.059668 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:56.060374 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:56.061256 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:56.062068 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:56.062409 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:56.062475 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:56.066493 (+ 4018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:56.066504 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:56.066504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:56.066514 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:56.068621 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:56.069217 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:56.069220 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:56.069221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:56.069309 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:56.069601 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:56.069602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:56.069603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:56.069800 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:56.069993 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:56.070132 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 07:06:56.070212 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":115,"threads_started":1}
W20260808 07:06:56.070936 9752 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34258
Aug 08 07:06:56 dist-test-slave-77v9 krb5kdc[9599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 07:06:56 dist-test-slave-77v9 krb5kdc[9599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.1@KRBTEST.COM
I20260808 07:06:56.101924 10125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:56.091239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34268 (local address 127.9.94.1:36827)
0808 07:06:56.091357 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:56.091359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:56.091372 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:06:56.091457 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:56.091458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:56.091471 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:56.091524 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:56.092319 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:56.093048 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:56.094083 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:56.094347 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:56.094422 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:56.098133 (+ 3711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:56.098135 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:56.098135 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:56.098144 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:56.099886 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:56.100510 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:56.100511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:56.100512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:56.100578 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:56.101086 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:56.101087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:56.101087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:56.101218 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:56.101350 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:56.101671 (+ 321us) server_negotiation.cc:299] Negotiation successful
0808 07:06:56.101799 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 07:06:56.102874 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 9708
I20260808 07:06:56.110953 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 9844
I20260808 07:06:56.117931 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 9984
I20260808 07:06:56.125927 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 9612
2026-08-08T07:06:56Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2303 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:56 dist-test-slave-77v9 krb5kdc[10132](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:56 dist-test-slave-77v9 krb5kdc[10132](info): set up 2 sockets
Aug 08 07:06:56 dist-test-slave-77v9 krb5kdc[10132](info): commencing operation
krb5kdc: starting...
W20260808 07:06:57.407716 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:06:57 dist-test-slave-77v9 krb5kdc[10132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:06:57.582115 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:39571
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:43081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:39571
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:57.686468 10145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:57.686964 10145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:57.687053 10145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:57.688930 10145 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:57.689031 10145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:57.689061 10145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:57.689092 10145 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:57.689126 10145 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:57.690997 10145 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:39571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:39571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:06:57.691327 10145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:57.691592 10145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:57.697548 10152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:57.697525 10154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:57.697570 10145 server_base.cc:1034] running on GCE node
W20260808 07:06:57.697526 10151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:57.698379 10145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:57.698755 10145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:57.700032 10145 hybrid_clock.cc:648] HybridClock initialized: now 1786172817699987 us; error 55 us; skew 500 ppm
Aug 08 07:06:57 dist-test-slave-77v9 krb5kdc[10132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172817, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:57.703727 10145 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:06:57.704280 10145 webserver.cc:460] Webserver started at http://127.9.94.62:34147/ using document root <none> and password file <none>
I20260808 07:06:57.704556 10145 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:57.704633 10145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:57.704849 10145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:57.706055 10145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "bc81fe44b11940aea56450bd324bab40"
format_stamp: "Formatted at 2026-08-08 07:06:57 on dist-test-slave-77v9"
server_key: "1e45a84982ba92be5b885bc7b50dbf5c"
server_key_iv: "309dc3d7c0220a6d8422911396fab304"
server_key_version: "encryptionkey@0"
I20260808 07:06:57.706511 10145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "bc81fe44b11940aea56450bd324bab40"
format_stamp: "Formatted at 2026-08-08 07:06:57 on dist-test-slave-77v9"
server_key: "1e45a84982ba92be5b885bc7b50dbf5c"
server_key_iv: "309dc3d7c0220a6d8422911396fab304"
server_key_version: "encryptionkey@0"
I20260808 07:06:57.709585 10145 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 07:06:57.710878 10162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:57.711300 10145 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:57.711477 10145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "bc81fe44b11940aea56450bd324bab40"
format_stamp: "Formatted at 2026-08-08 07:06:57 on dist-test-slave-77v9"
server_key: "1e45a84982ba92be5b885bc7b50dbf5c"
server_key_iv: "309dc3d7c0220a6d8422911396fab304"
server_key_version: "encryptionkey@0"
I20260808 07:06:57.711576 10145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:57.738417 10145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:57.741994 10145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:57.742233 10145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:57.748018 10145 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:39571
I20260808 07:06:57.748062 10216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:39571 every 8 connection(s)
I20260808 07:06:57.748486 10145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:57.749737 10217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:57.750603 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 10145
I20260808 07:06:57.750717 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:06:57.750896 9592 external_mini_cluster.cc:1428] Setting key 346f8263a890b89471a271ed9f279576
I20260808 07:06:57.753619 10217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40: Bootstrap starting.
I20260808 07:06:57.754799 10217 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:57.755227 10217 log.cc:824] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:57.756055 10217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40: No bootstrap required, opened a new log
Aug 08 07:06:57 dist-test-slave-77v9 krb5kdc[10132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:06:57.758664 10217 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc81fe44b11940aea56450bd324bab40" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39571 } }
I20260808 07:06:57.758865 10217 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:57.758944 10217 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc81fe44b11940aea56450bd324bab40, State: Initialized, Role: FOLLOWER
I20260808 07:06:57.759094 10217 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc81fe44b11940aea56450bd324bab40" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39571 } }
I20260808 07:06:57.759181 10217 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:06:57.759205 10217 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:06:57.759274 10217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:57.760048 10217 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc81fe44b11940aea56450bd324bab40" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39571 } }
I20260808 07:06:57.760178 10217 leader_election.cc:302] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc81fe44b11940aea56450bd324bab40; no voters:
I20260808 07:06:57.760390 10217 leader_election.cc:288] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:06:57.760674 10222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:57.760740 10217 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:57.760936 10222 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [term 1 LEADER]: Becoming Leader. State: Replica: bc81fe44b11940aea56450bd324bab40, State: Running, Role: LEADER
I20260808 07:06:57.761052 10222 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc81fe44b11940aea56450bd324bab40" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39571 } }
I20260808 07:06:57.761430 10223 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc81fe44b11940aea56450bd324bab40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc81fe44b11940aea56450bd324bab40" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39571 } } }
I20260808 07:06:57.761540 10223 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:57.761826 10231 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:57.762543 10231 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:06:57.762929 10224 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc81fe44b11940aea56450bd324bab40. Latest consensus state: current_term: 1 leader_uuid: "bc81fe44b11940aea56450bd324bab40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc81fe44b11940aea56450bd324bab40" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39571 } } }
I20260808 07:06:57.763011 10224 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:57.764614 10220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:57.751758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41848 (local address 127.9.94.62:39571)
0808 07:06:57.752170 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:57.752178 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:57.752227 (+ 49us) server_negotiation.cc:407] Connection header received
0808 07:06:57.752671 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:57.752677 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:57.752725 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:57.753063 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:57.753752 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:57.754685 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:57.755625 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:57.756066 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:57.756188 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:57.759458 (+ 3270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:57.759462 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:57.759463 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:57.759475 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:57.762557 (+ 3082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:57.763130 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:57.763134 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:57.763135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:57.763263 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:57.763545 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:57.763546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:57.763547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:57.763862 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:57.764063 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:57.764190 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 07:06:57.764368 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":100,"threads_started":1}
I20260808 07:06:57.765282 10231 catalog_manager.cc:1347] Generated new cluster ID: 9cc73b1dab004ea49ee3531c0b4c154e
I20260808 07:06:57.765350 10231 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:06:57.779402 10231 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:06:57.780282 10231 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:57.794864 10231 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc81fe44b11940aea56450bd324bab40: Generated new TSK 0
I20260808 07:06:57.795137 10231 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:06:57.837508 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39571
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:43081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:57.938901 10243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:57.939152 10243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:57.939182 10243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:57.941211 10243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:57.941319 10243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:57.941362 10243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:06:57.943780 10243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39571
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:06:57.944186 10243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:57.944566 10243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:57.952538 10248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:57.952551 10251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:57.952565 10249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:57.952674 10243 server_base.cc:1034] running on GCE node
I20260808 07:06:57.953171 10243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:57.953485 10243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:57.954674 10243 hybrid_clock.cc:648] HybridClock initialized: now 1786172817954649 us; error 47 us; skew 500 ppm
Aug 08 07:06:57 dist-test-slave-77v9 krb5kdc[10132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172817, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:57.958565 10243 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:06:57.959758 10243 webserver.cc:460] Webserver started at http://127.9.94.1:39193/ using document root <none> and password file <none>
I20260808 07:06:57.960134 10243 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:57.960224 10243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:57.960424 10243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:57.962438 10243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "713d75f155f4468d9c7d13583fed88ea"
format_stamp: "Formatted at 2026-08-08 07:06:57 on dist-test-slave-77v9"
server_key: "0dc76e9443032485f0b0d3ffbe0fa908"
server_key_iv: "c36240050558b0cbde90bb87636d74c0"
server_key_version: "encryptionkey@0"
I20260808 07:06:57.962985 10243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "713d75f155f4468d9c7d13583fed88ea"
format_stamp: "Formatted at 2026-08-08 07:06:57 on dist-test-slave-77v9"
server_key: "0dc76e9443032485f0b0d3ffbe0fa908"
server_key_iv: "c36240050558b0cbde90bb87636d74c0"
server_key_version: "encryptionkey@0"
I20260808 07:06:57.965131 10243 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260808 07:06:57.966321 10258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:57.966979 10243 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:57.967140 10243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "713d75f155f4468d9c7d13583fed88ea"
format_stamp: "Formatted at 2026-08-08 07:06:57 on dist-test-slave-77v9"
server_key: "0dc76e9443032485f0b0d3ffbe0fa908"
server_key_iv: "c36240050558b0cbde90bb87636d74c0"
server_key_version: "encryptionkey@0"
I20260808 07:06:57.967239 10243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:57.984205 10243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:57.987144 10243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:57.987367 10243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:57.987689 10243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:57.988094 10243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:57.988160 10243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:57.988209 10243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:57.988243 10243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:57.998555 10243 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:34491
I20260808 07:06:57.998931 10375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:34491 every 8 connection(s)
I20260808 07:06:57.999058 10243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:06:58 dist-test-slave-77v9 krb5kdc[10132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172817, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:06:58.007107 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 10243
I20260808 07:06:58.007282 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:06:58.007512 9592 external_mini_cluster.cc:1428] Setting key 27ed44be69290eafda9af9d594258322
I20260808 07:06:58.010536 10220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:57.999958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:60653 (local address 127.9.94.62:39571)
0808 07:06:58.000040 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:58.000043 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:58.000234 (+ 191us) server_negotiation.cc:407] Connection header received
0808 07:06:58.001316 (+ 1082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:58.001317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:58.001331 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:58.001396 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:58.002074 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.002631 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.003678 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.003902 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.003985 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.006365 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:58.006367 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:58.006367 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:58.006376 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:58.008131 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:58.009236 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:58.009237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:58.009238 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:58.009317 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:58.009642 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:58.009643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:58.009643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:58.009778 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:58.009863 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:58.010206 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 07:06:58.010322 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 07:06:58.011343 10378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:57.999890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39571 (local address 127.9.94.1:60653)
0808 07:06:58.000080 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:58.000121 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:58.001190 (+ 1069us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:58.001471 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:58.001475 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:58.001758 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:58.001975 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.001979 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.002735 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.002736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.003569 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.003571 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.003994 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.003995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.004120 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.004712 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:58.004721 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:58.006261 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:58.008218 (+ 1957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:58.008227 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:58.008230 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:58.009127 (+ 897us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:58.009400 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:58.009401 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:58.009401 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:58.009556 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:58.009868 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:58.009875 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:58.010050 (+ 175us) client_negotiation.cc:769] Sending connection context
0808 07:06:58.010166 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 07:06:58.010361 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":101,"threads_started":1}
I20260808 07:06:58.012387 10376 heartbeater.cc:347] Connected to a master server at 127.9.94.62:39571
I20260808 07:06:58.012506 10376 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:58.012758 10376 heartbeater.cc:511] Master 127.9.94.62:39571 requested a full tablet report, sending...
I20260808 07:06:58.013473 10179 ts_manager.cc:194] Registered new tserver with Master: 713d75f155f4468d9c7d13583fed88ea (127.9.94.1:34491)
I20260808 07:06:58.014218 10179 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:60653
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:06:58.053311 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39571
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:43081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:58.161238 10381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:58.161551 10381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:58.161602 10381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:58.163359 10381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:58.163424 10381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:58.163458 10381 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:06:58.165548 10381 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39571
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:06:58.165854 10381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:58.166138 10381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:58.172633 10389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:58.172633 10386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:58.172670 10381 server_base.cc:1034] running on GCE node
W20260808 07:06:58.172633 10387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:58.173316 10381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:58.173671 10381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:58.174855 10381 hybrid_clock.cc:648] HybridClock initialized: now 1786172818174839 us; error 63 us; skew 500 ppm
Aug 08 07:06:58 dist-test-slave-77v9 krb5kdc[10132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172818, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:58.178471 10381 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:06:58.179395 10381 webserver.cc:460] Webserver started at http://127.9.94.2:36283/ using document root <none> and password file <none>
I20260808 07:06:58.179664 10381 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:58.179756 10381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:58.179922 10381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:58.181252 10381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "b8440e25cec041acafc17b516c593673"
format_stamp: "Formatted at 2026-08-08 07:06:58 on dist-test-slave-77v9"
server_key: "4d48c0335abfd77c6d7fb2ee1a12ca26"
server_key_iv: "8e506bb22f09db05bf693cc22abe3d0a"
server_key_version: "encryptionkey@0"
I20260808 07:06:58.181676 10381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "b8440e25cec041acafc17b516c593673"
format_stamp: "Formatted at 2026-08-08 07:06:58 on dist-test-slave-77v9"
server_key: "4d48c0335abfd77c6d7fb2ee1a12ca26"
server_key_iv: "8e506bb22f09db05bf693cc22abe3d0a"
server_key_version: "encryptionkey@0"
I20260808 07:06:58.183298 10381 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:06:58.184999 10396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:58.185223 10381 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260808 07:06:58.185360 10381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "b8440e25cec041acafc17b516c593673"
format_stamp: "Formatted at 2026-08-08 07:06:58 on dist-test-slave-77v9"
server_key: "4d48c0335abfd77c6d7fb2ee1a12ca26"
server_key_iv: "8e506bb22f09db05bf693cc22abe3d0a"
server_key_version: "encryptionkey@0"
I20260808 07:06:58.185425 10381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:58.198416 10381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:58.200901 10381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:58.201085 10381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:58.201391 10381 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:58.201757 10381 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:58.201805 10381 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:58.201829 10381 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:58.201843 10381 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:58.209703 10381 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:33713
I20260808 07:06:58.209949 10512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:33713 every 8 connection(s)
I20260808 07:06:58.210146 10381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:06:58.212723 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 10381
I20260808 07:06:58.212904 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:06:58.213152 9592 external_mini_cluster.cc:1428] Setting key 6762ea197095fd56475598c43038e00c
Aug 08 07:06:58 dist-test-slave-77v9 krb5kdc[10132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172818, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:06:58.222448 10220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.211122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:50343 (local address 127.9.94.62:39571)
0808 07:06:58.211229 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:58.211232 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:58.211448 (+ 216us) server_negotiation.cc:407] Connection header received
0808 07:06:58.212555 (+ 1107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:58.212556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:58.212569 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:58.212634 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:58.213916 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.214798 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.216091 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.216381 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.216440 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.219387 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:58.219388 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:58.219388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:58.219397 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:58.220947 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:58.221408 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:58.221410 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:58.221410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:58.221472 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:58.221752 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:58.221753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:58.221754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:58.221877 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:58.221947 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:58.222255 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 07:06:58.222346 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 07:06:58.222700 10515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.211040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39571 (local address 127.9.94.2:50343)
0808 07:06:58.211317 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:58.211357 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:58.212393 (+ 1036us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:58.212712 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:58.212716 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:58.213327 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:58.213786 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.213793 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.214944 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.214945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.215997 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.216000 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.216466 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.216467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.216629 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.217365 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:58.217377 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:58.219266 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:58.221049 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:58.221057 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:58.221060 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:58.221326 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:58.221540 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:58.221541 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:58.221541 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:58.221667 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:58.221952 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:58.221959 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:58.222114 (+ 155us) client_negotiation.cc:769] Sending connection context
0808 07:06:58.222223 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 07:06:58.222416 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":94,"threads_started":1}
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
I20260808 07:06:58.223230 10513 heartbeater.cc:347] Connected to a master server at 127.9.94.62:39571
I20260808 07:06:58.223348 10513 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:58.223548 10513 heartbeater.cc:511] Master 127.9.94.62:39571 requested a full tablet report, sending...
I20260808 07:06:58.224378 10179 ts_manager.cc:194] Registered new tserver with Master: b8440e25cec041acafc17b516c593673 (127.9.94.2:33713)
I20260808 07:06:58.224908 10179 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:50343
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:06:58.250880 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39571
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:43081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:58.340299 10518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:58.340547 10518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:58.340574 10518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:58.341810 10518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:58.341859 10518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:58.341889 10518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:06:58.343449 10518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39571
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:06:58.343717 10518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:58.343990 10518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:58.350021 10527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:58.350029 10523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:58.350032 10524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:58.350049 10518 server_base.cc:1034] running on GCE node
I20260808 07:06:58.350502 10518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:58.350800 10518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:58.352003 10518 hybrid_clock.cc:648] HybridClock initialized: now 1786172818352016 us; error 67 us; skew 500 ppm
Aug 08 07:06:58 dist-test-slave-77v9 krb5kdc[10132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172818, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:58.355648 10518 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:06:58.356213 10518 webserver.cc:460] Webserver started at http://127.9.94.3:44165/ using document root <none> and password file <none>
I20260808 07:06:58.357103 10518 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:58.357201 10518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:58.357453 10518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:58.359511 10518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "2316cbea42164ddaa8a7bc113788a30e"
format_stamp: "Formatted at 2026-08-08 07:06:58 on dist-test-slave-77v9"
server_key: "e85a6aceca4574c330dedeabf1a80885"
server_key_iv: "6d2fbda832523a04447eb5cd70acb01e"
server_key_version: "encryptionkey@0"
I20260808 07:06:58.360071 10518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "2316cbea42164ddaa8a7bc113788a30e"
format_stamp: "Formatted at 2026-08-08 07:06:58 on dist-test-slave-77v9"
server_key: "e85a6aceca4574c330dedeabf1a80885"
server_key_iv: "6d2fbda832523a04447eb5cd70acb01e"
server_key_version: "encryptionkey@0"
I20260808 07:06:58.362020 10518 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.003s
I20260808 07:06:58.362972 10534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:58.363281 10518 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:58.363457 10518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "2316cbea42164ddaa8a7bc113788a30e"
format_stamp: "Formatted at 2026-08-08 07:06:58 on dist-test-slave-77v9"
server_key: "e85a6aceca4574c330dedeabf1a80885"
server_key_iv: "6d2fbda832523a04447eb5cd70acb01e"
server_key_version: "encryptionkey@0"
I20260808 07:06:58.363554 10518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:58.384163 10518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:58.388114 10518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:58.388329 10518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:58.388672 10518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:58.389122 10518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:58.389199 10518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:58.389247 10518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:58.389278 10518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:58.396989 10518 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:36221
I20260808 07:06:58.397039 10649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:36221 every 8 connection(s)
I20260808 07:06:58.397498 10518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:06:58.397871 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 10518
I20260808 07:06:58.398005 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:06:58.398201 9592 external_mini_cluster.cc:1428] Setting key c27040e4e06f5ee91af4f481db8222af
Aug 08 07:06:58 dist-test-slave-77v9 krb5kdc[10132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172818, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:06:58.410019 10220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.398571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:55921 (local address 127.9.94.62:39571)
0808 07:06:58.398649 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:58.398652 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:58.399106 (+ 454us) server_negotiation.cc:407] Connection header received
0808 07:06:58.400265 (+ 1159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:58.400266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:58.400279 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:58.400325 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:58.401132 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.401662 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.402754 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.402976 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.403068 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.405764 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:58.405768 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:58.405768 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:58.405781 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:58.407726 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:58.408474 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:58.408476 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:58.408476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:58.408559 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:58.409085 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:58.409087 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:58.409087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:58.409227 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:58.409302 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:58.409809 (+ 507us) server_negotiation.cc:299] Negotiation successful
0808 07:06:58.409927 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 07:06:58.410262 10652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.398545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39571 (local address 127.9.94.3:55921)
0808 07:06:58.398924 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:58.399000 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:58.400149 (+ 1149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:58.400404 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:58.400409 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:58.400712 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:58.401029 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.401034 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.401772 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.401773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.402655 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.402657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.403082 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.403083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.403220 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.403817 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:58.403826 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:58.405583 (+ 1757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:58.407904 (+ 2321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:58.407922 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:58.407925 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:58.408328 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:58.408700 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:58.408701 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:58.408702 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:58.408968 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:58.409361 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:58.409371 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:58.409554 (+ 183us) client_negotiation.cc:769] Sending connection context
0808 07:06:58.409660 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 07:06:58.409894 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":137,"threads_started":1}
I20260808 07:06:58.411003 10650 heartbeater.cc:347] Connected to a master server at 127.9.94.62:39571
I20260808 07:06:58.411146 10650 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:58.411369 10650 heartbeater.cc:511] Master 127.9.94.62:39571 requested a full tablet report, sending...
I20260808 07:06:58.411862 10178 ts_manager.cc:194] Registered new tserver with Master: 2316cbea42164ddaa8a7bc113788a30e (127.9.94.3:36221)
I20260808 07:06:58.412307 10178 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:55921
I20260808 07:06:58.422406 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:06:58.433856 10220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.424449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41850 (local address 127.9.94.62:39571)
0808 07:06:58.424614 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:58.424616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:58.424722 (+ 106us) server_negotiation.cc:407] Connection header received
0808 07:06:58.424984 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:58.424986 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:58.425008 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:58.425083 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:58.425894 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.426528 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.427384 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.427597 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.427679 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.429617 (+ 1938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:58.429619 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:58.429619 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:58.429631 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:58.431830 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:58.432350 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:58.432351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:58.432351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:58.432425 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:58.432683 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:58.432684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:58.432684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:58.432967 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:58.433138 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:58.433470 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 07:06:58.433580 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260808 07:06:58.437815 10178 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41850:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:06:58.439684 10178 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:06:58.447986 10664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.443144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47408 (local address 127.9.94.2:33713)
0808 07:06:58.443361 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:58.443367 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:58.443577 (+ 210us) server_negotiation.cc:407] Connection header received
0808 07:06:58.443619 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:58.443621 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:58.443634 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:58.443695 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:58.443950 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.445265 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.446628 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.447455 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.447549 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.447609 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:58.447810 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 07:06:58.447861 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":101,"threads_started":1}
I20260808 07:06:58.448092 10663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.442996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:34491 (local address 127.0.0.1:51230)
0808 07:06:58.443431 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:58.443445 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:58.443510 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:58.444188 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:58.444189 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:58.444191 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:58.444258 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.444260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.445667 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.445668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.446521 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.446523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.447505 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.447506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.447620 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.447636 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 07:06:58.447752 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 07:06:58.447817 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":3,"thread_start_us":99,"threads_started":1}
I20260808 07:06:58.448256 10662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.442977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:33713 (local address 127.0.0.1:47408)
0808 07:06:58.443355 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:58.443401 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:58.443484 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:58.443715 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:58.443718 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:58.443720 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:58.443804 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.443806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.445392 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.445393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.446511 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.446514 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.447648 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.447649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.447716 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.447720 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:06:58.448105 (+ 385us) client_negotiation.cc:240] Negotiation successful
0808 07:06:58.448159 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":66,"thread_start_us":90,"threads_started":1}
I20260808 07:06:58.449203 10667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.443494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38700 (local address 127.9.94.3:36221)
0808 07:06:58.443682 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:58.443699 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:58.443879 (+ 180us) server_negotiation.cc:407] Connection header received
0808 07:06:58.443970 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:58.443973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:58.443993 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:58.444068 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:58.444215 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.445203 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.447985 (+ 2782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.448747 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.448893 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.448963 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:58.449074 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 07:06:58.449117 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":110,"threads_started":1}
I20260808 07:06:58.449187 10665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.443246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:36221 (local address 127.0.0.1:38700)
0808 07:06:58.443793 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:58.443801 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:58.443850 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:58.444083 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:58.444084 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:58.444086 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:58.444155 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.444157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.445334 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.445335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.447879 (+ 2544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.447881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.448898 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.448899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.448987 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.448991 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:06:58.449058 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 07:06:58.449105 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"mutex_wait_us":1086,"thread_start_us":92,"threads_started":1}
I20260808 07:06:58.449251 10666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.443218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51230 (local address 127.9.94.1:34491)
0808 07:06:58.443997 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:58.444002 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:58.444013 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:06:58.444057 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:58.444059 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:58.444076 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:58.444337 (+ 261us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:58.444413 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.445572 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.446686 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.447406 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.447507 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.447576 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:58.447768 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 07:06:58.447817 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":740,"thread_start_us":124,"threads_started":1}
I20260808 07:06:58.449714 10445 tablet_service.cc:1467] Processing CreateTablet for tablet 886cb6a3ccd44dffa23600844cfce797 (DEFAULT_TABLE table=test-table [id=d68f55389e99482dadb836a2513c16e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:58.450183 10445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 886cb6a3ccd44dffa23600844cfce797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:58.450122 10307 tablet_service.cc:1467] Processing CreateTablet for tablet 886cb6a3ccd44dffa23600844cfce797 (DEFAULT_TABLE table=test-table [id=d68f55389e99482dadb836a2513c16e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:58.450273 10583 tablet_service.cc:1467] Processing CreateTablet for tablet 886cb6a3ccd44dffa23600844cfce797 (DEFAULT_TABLE table=test-table [id=d68f55389e99482dadb836a2513c16e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:58.450481 10307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 886cb6a3ccd44dffa23600844cfce797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:58.450654 10583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 886cb6a3ccd44dffa23600844cfce797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:58.453953 10668 tablet_bootstrap.cc:492] T 886cb6a3ccd44dffa23600844cfce797 P 2316cbea42164ddaa8a7bc113788a30e: Bootstrap starting.
I20260808 07:06:58.454452 10670 tablet_bootstrap.cc:492] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea: Bootstrap starting.
I20260808 07:06:58.454864 10668 tablet_bootstrap.cc:654] T 886cb6a3ccd44dffa23600844cfce797 P 2316cbea42164ddaa8a7bc113788a30e: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:58.455134 10670 tablet_bootstrap.cc:654] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:58.455488 10668 log.cc:824] T 886cb6a3ccd44dffa23600844cfce797 P 2316cbea42164ddaa8a7bc113788a30e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:58.455709 10670 log.cc:824] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:58.456148 10669 tablet_bootstrap.cc:492] T 886cb6a3ccd44dffa23600844cfce797 P b8440e25cec041acafc17b516c593673: Bootstrap starting.
I20260808 07:06:58.456529 10668 tablet_bootstrap.cc:492] T 886cb6a3ccd44dffa23600844cfce797 P 2316cbea42164ddaa8a7bc113788a30e: No bootstrap required, opened a new log
I20260808 07:06:58.456622 10670 tablet_bootstrap.cc:492] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea: No bootstrap required, opened a new log
I20260808 07:06:58.456615 10668 ts_tablet_manager.cc:1397] T 886cb6a3ccd44dffa23600844cfce797 P 2316cbea42164ddaa8a7bc113788a30e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:06:58.456696 10670 ts_tablet_manager.cc:1397] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:06:58.456962 10669 tablet_bootstrap.cc:654] T 886cb6a3ccd44dffa23600844cfce797 P b8440e25cec041acafc17b516c593673: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:58.457511 10669 log.cc:824] T 886cb6a3ccd44dffa23600844cfce797 P b8440e25cec041acafc17b516c593673: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:58.458442 10669 tablet_bootstrap.cc:492] T 886cb6a3ccd44dffa23600844cfce797 P b8440e25cec041acafc17b516c593673: No bootstrap required, opened a new log
I20260808 07:06:58.458544 10669 ts_tablet_manager.cc:1397] T 886cb6a3ccd44dffa23600844cfce797 P b8440e25cec041acafc17b516c593673: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:06:58.459012 10670 raft_consensus.cc:348] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8440e25cec041acafc17b516c593673" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 33713 } } peers { permanent_uuid: "713d75f155f4468d9c7d13583fed88ea" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 34491 } } peers { permanent_uuid: "2316cbea42164ddaa8a7bc113788a30e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36221 } }
I20260808 07:06:58.459012 10668 raft_consensus.cc:348] T 886cb6a3ccd44dffa23600844cfce797 P 2316cbea42164ddaa8a7bc113788a30e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8440e25cec041acafc17b516c593673" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 33713 } } peers { permanent_uuid: "713d75f155f4468d9c7d13583fed88ea" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 34491 } } peers { permanent_uuid: "2316cbea42164ddaa8a7bc113788a30e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36221 } }
I20260808 07:06:58.459244 10668 raft_consensus.cc:374] T 886cb6a3ccd44dffa23600844cfce797 P 2316cbea42164ddaa8a7bc113788a30e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:58.459244 10670 raft_consensus.cc:374] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:58.459288 10668 raft_consensus.cc:729] T 886cb6a3ccd44dffa23600844cfce797 P 2316cbea42164ddaa8a7bc113788a30e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2316cbea42164ddaa8a7bc113788a30e, State: Initialized, Role: FOLLOWER
I20260808 07:06:58.459288 10670 raft_consensus.cc:729] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 713d75f155f4468d9c7d13583fed88ea, State: Initialized, Role: FOLLOWER
I20260808 07:06:58.459438 10670 consensus_queue.cc:260] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8440e25cec041acafc17b516c593673" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 33713 } } peers { permanent_uuid: "713d75f155f4468d9c7d13583fed88ea" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 34491 } } peers { permanent_uuid: "2316cbea42164ddaa8a7bc113788a30e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36221 } }
I20260808 07:06:58.459470 10668 consensus_queue.cc:260] T 886cb6a3ccd44dffa23600844cfce797 P 2316cbea42164ddaa8a7bc113788a30e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8440e25cec041acafc17b516c593673" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 33713 } } peers { permanent_uuid: "713d75f155f4468d9c7d13583fed88ea" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 34491 } } peers { permanent_uuid: "2316cbea42164ddaa8a7bc113788a30e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36221 } }
I20260808 07:06:58.459798 10670 ts_tablet_manager.cc:1428] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 07:06:58.459810 10668 ts_tablet_manager.cc:1428] T 886cb6a3ccd44dffa23600844cfce797 P 2316cbea42164ddaa8a7bc113788a30e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:06:58.459945 10376 heartbeater.cc:503] Master 127.9.94.62:39571 was elected leader, sending a full tablet report...
I20260808 07:06:58.460340 10650 heartbeater.cc:503] Master 127.9.94.62:39571 was elected leader, sending a full tablet report...
I20260808 07:06:58.461369 10669 raft_consensus.cc:348] T 886cb6a3ccd44dffa23600844cfce797 P b8440e25cec041acafc17b516c593673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8440e25cec041acafc17b516c593673" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 33713 } } peers { permanent_uuid: "713d75f155f4468d9c7d13583fed88ea" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 34491 } } peers { permanent_uuid: "2316cbea42164ddaa8a7bc113788a30e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36221 } }
I20260808 07:06:58.461570 10669 raft_consensus.cc:374] T 886cb6a3ccd44dffa23600844cfce797 P b8440e25cec041acafc17b516c593673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:58.461607 10669 raft_consensus.cc:729] T 886cb6a3ccd44dffa23600844cfce797 P b8440e25cec041acafc17b516c593673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8440e25cec041acafc17b516c593673, State: Initialized, Role: FOLLOWER
I20260808 07:06:58.461704 10669 consensus_queue.cc:260] T 886cb6a3ccd44dffa23600844cfce797 P b8440e25cec041acafc17b516c593673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8440e25cec041acafc17b516c593673" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 33713 } } peers { permanent_uuid: "713d75f155f4468d9c7d13583fed88ea" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 34491 } } peers { permanent_uuid: "2316cbea42164ddaa8a7bc113788a30e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36221 } }
I20260808 07:06:58.462081 10669 ts_tablet_manager.cc:1428] T 886cb6a3ccd44dffa23600844cfce797 P b8440e25cec041acafc17b516c593673: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 07:06:58.462100 10513 heartbeater.cc:503] Master 127.9.94.62:39571 was elected leader, sending a full tablet report...
W20260808 07:06:58.500129 10377 tablet.cc:2369] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:06:58.648507 10651 tablet.cc:2369] T 886cb6a3ccd44dffa23600844cfce797 P 2316cbea42164ddaa8a7bc113788a30e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:06:58.694690 10674 raft_consensus.cc:482] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:06:58.694835 10674 raft_consensus.cc:504] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8440e25cec041acafc17b516c593673" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 33713 } } peers { permanent_uuid: "713d75f155f4468d9c7d13583fed88ea" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 34491 } } peers { permanent_uuid: "2316cbea42164ddaa8a7bc113788a30e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36221 } }
I20260808 07:06:58.695294 10674 leader_election.cc:288] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8440e25cec041acafc17b516c593673 (127.9.94.2:33713), 2316cbea42164ddaa8a7bc113788a30e (127.9.94.3:36221)
I20260808 07:06:58.699076 10677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.695584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:33713 (local address 127.9.94.1:47437)
0808 07:06:58.695981 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:58.696103 (+ 122us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:58.696193 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:58.696390 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:58.696391 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:58.696393 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:58.696476 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.696479 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.697213 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.697214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.698161 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.698164 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.698768 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.698769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.698849 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.698853 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:06:58.698934 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 07:06:58.698981 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"mutex_wait_us":89,"thread_start_us":100,"threads_started":1}
I20260808 07:06:58.699056 10664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.696175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:47437 (local address 127.9.94.2:33713)
0808 07:06:58.696235 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:58.696238 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:58.696246 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:06:58.696278 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:58.696278 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:58.696294 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:58.696381 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:58.696572 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.697124 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.698301 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.698665 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.698764 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.698775 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:58.698946 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 07:06:58.698982 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:06:58.699193 10667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.695936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:52635 (local address 127.9.94.3:36221)
0808 07:06:58.695996 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:58.695998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:58.696127 (+ 129us) server_negotiation.cc:407] Connection header received
0808 07:06:58.696239 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:58.696240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:58.696251 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:58.696333 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:58.696622 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.697243 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.698368 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.698787 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.698882 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.698893 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:58.699082 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 07:06:58.699125 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:06:58.699241 10678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.695865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:36221 (local address 127.9.94.1:52635)
0808 07:06:58.696018 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:58.696030 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:58.696146 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:58.696341 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:58.696342 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:58.696344 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:58.696512 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.696515 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.697350 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.697351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.698191 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:58.698193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.698884 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.698885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:58.698981 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.698985 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:06:58.699073 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 07:06:58.699117 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":58,"threads_started":1}
I20260808 07:06:58.699676 10466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "886cb6a3ccd44dffa23600844cfce797" candidate_uuid: "713d75f155f4468d9c7d13583fed88ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8440e25cec041acafc17b516c593673" is_pre_election: true
I20260808 07:06:58.699792 10604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "886cb6a3ccd44dffa23600844cfce797" candidate_uuid: "713d75f155f4468d9c7d13583fed88ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2316cbea42164ddaa8a7bc113788a30e" is_pre_election: true
I20260808 07:06:58.699882 10466 raft_consensus.cc:2454] T 886cb6a3ccd44dffa23600844cfce797 P b8440e25cec041acafc17b516c593673 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 713d75f155f4468d9c7d13583fed88ea in term 0.
I20260808 07:06:58.699922 10604 raft_consensus.cc:2454] T 886cb6a3ccd44dffa23600844cfce797 P 2316cbea42164ddaa8a7bc113788a30e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 713d75f155f4468d9c7d13583fed88ea in term 0.
I20260808 07:06:58.700161 10262 leader_election.cc:302] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2316cbea42164ddaa8a7bc113788a30e, 713d75f155f4468d9c7d13583fed88ea; no voters:
I20260808 07:06:58.700374 10674 raft_consensus.cc:2781] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:06:58.700472 10674 raft_consensus.cc:482] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:06:58.700502 10674 raft_consensus.cc:3037] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:58.701373 10674 raft_consensus.cc:504] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8440e25cec041acafc17b516c593673" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 33713 } } peers { permanent_uuid: "713d75f155f4468d9c7d13583fed88ea" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 34491 } } peers { permanent_uuid: "2316cbea42164ddaa8a7bc113788a30e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36221 } }
I20260808 07:06:58.701548 10674 leader_election.cc:288] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [CANDIDATE]: Term 1 election: Requested vote from peers b8440e25cec041acafc17b516c593673 (127.9.94.2:33713), 2316cbea42164ddaa8a7bc113788a30e (127.9.94.3:36221)
I20260808 07:06:58.701828 10466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "886cb6a3ccd44dffa23600844cfce797" candidate_uuid: "713d75f155f4468d9c7d13583fed88ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8440e25cec041acafc17b516c593673"
I20260808 07:06:58.701828 10604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "886cb6a3ccd44dffa23600844cfce797" candidate_uuid: "713d75f155f4468d9c7d13583fed88ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2316cbea42164ddaa8a7bc113788a30e"
I20260808 07:06:58.701956 10466 raft_consensus.cc:3037] T 886cb6a3ccd44dffa23600844cfce797 P b8440e25cec041acafc17b516c593673 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:58.701956 10604 raft_consensus.cc:3037] T 886cb6a3ccd44dffa23600844cfce797 P 2316cbea42164ddaa8a7bc113788a30e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:58.702941 10466 raft_consensus.cc:2454] T 886cb6a3ccd44dffa23600844cfce797 P b8440e25cec041acafc17b516c593673 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 713d75f155f4468d9c7d13583fed88ea in term 1.
I20260808 07:06:58.703022 10604 raft_consensus.cc:2454] T 886cb6a3ccd44dffa23600844cfce797 P 2316cbea42164ddaa8a7bc113788a30e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 713d75f155f4468d9c7d13583fed88ea in term 1.
I20260808 07:06:58.703192 10262 leader_election.cc:302] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2316cbea42164ddaa8a7bc113788a30e, 713d75f155f4468d9c7d13583fed88ea; no voters:
I20260808 07:06:58.703357 10674 raft_consensus.cc:2781] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:58.703536 10674 raft_consensus.cc:686] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [term 1 LEADER]: Becoming Leader. State: Replica: 713d75f155f4468d9c7d13583fed88ea, State: Running, Role: LEADER
I20260808 07:06:58.703614 10674 consensus_queue.cc:237] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8440e25cec041acafc17b516c593673" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 33713 } } peers { permanent_uuid: "713d75f155f4468d9c7d13583fed88ea" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 34491 } } peers { permanent_uuid: "2316cbea42164ddaa8a7bc113788a30e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36221 } }
I20260808 07:06:58.704733 10178 catalog_manager.cc:5495] T 886cb6a3ccd44dffa23600844cfce797 P 713d75f155f4468d9c7d13583fed88ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 713d75f155f4468d9c7d13583fed88ea (127.9.94.1). New cstate: current_term: 1 leader_uuid: "713d75f155f4468d9c7d13583fed88ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8440e25cec041acafc17b516c593673" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 33713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "713d75f155f4468d9c7d13583fed88ea" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 34491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2316cbea42164ddaa8a7bc113788a30e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36221 } health_report { overall_health: UNKNOWN } } }
W20260808 07:06:58.711154 10514 tablet.cc:2369] T 886cb6a3ccd44dffa23600844cfce797 P b8440e25cec041acafc17b516c593673: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 07:06:58 dist-test-slave-77v9 krb5kdc[10132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.1@KRBTEST.COM
I20260808 07:06:58.748997 10666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.737683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51238 (local address 127.9.94.1:34491)
0808 07:06:58.737792 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:58.737795 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:58.737959 (+ 164us) server_negotiation.cc:407] Connection header received
0808 07:06:58.737993 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:58.737994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:58.738009 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:58.738076 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:58.738840 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.739395 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.740195 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.740408 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.740475 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.743936 (+ 3461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:58.743955 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:58.743955 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:58.743965 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:58.746730 (+ 2765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:58.747469 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:58.747477 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:58.747477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:58.747617 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:58.747998 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:58.748000 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:58.748000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:58.748242 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:58.748431 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:58.748727 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 07:06:58.748883 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
Aug 08 07:06:58 dist-test-slave-77v9 krb5kdc[10132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172818, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 07:06:58 dist-test-slave-77v9 krb5kdc[10132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172818, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.94.1@KRBTEST.COM
I20260808 07:06:58.779899 10666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.769773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51252 (local address 127.9.94.1:34491)
0808 07:06:58.769860 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:58.769862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:58.769919 (+ 57us) server_negotiation.cc:407] Connection header received
0808 07:06:58.769947 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:58.769948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:58.769958 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:58.770023 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:58.770691 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.771366 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.772590 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.772803 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.773035 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.776456 (+ 3421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:58.776458 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:58.776458 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:58.776467 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:58.778472 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:58.778967 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:58.778968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:58.778969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:58.779028 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:58.779270 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:58.779271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:58.779271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:58.779390 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:58.779493 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:58.779693 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 07:06:58.779822 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Aug 08 07:06:58 dist-test-slave-77v9 krb5kdc[10132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 07:06:58 dist-test-slave-77v9 krb5kdc[10132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.1@KRBTEST.COM
I20260808 07:06:58.812742 10666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:58.802480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51268 (local address 127.9.94.1:34491)
0808 07:06:58.802669 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:58.802672 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:58.802775 (+ 103us) server_negotiation.cc:407] Connection header received
0808 07:06:58.802894 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:58.802896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:58.802911 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:58.803006 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:58.803842 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.804383 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.805451 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:58.805666 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:58.805805 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:58.809511 (+ 3706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:58.809515 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:58.809515 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:58.809526 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:58.811378 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:58.811862 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:58.811863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:58.811864 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:58.811930 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:58.812168 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:58.812169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:58.812169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:58.812285 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:58.812426 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:58.812532 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 07:06:58.812625 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260808 07:06:58.813386 10286 tablet_service.cc:2908] Rejecting scan request for tablet 886cb6a3ccd44dffa23600844cfce797: Uninitialized: clean time has not yet been initialized
I20260808 07:06:58.814793 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 10243
I20260808 07:06:58.823364 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 10381
I20260808 07:06:58.830111 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 10518
I20260808 07:06:58.836306 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 10145
2026-08-08T07:06:58Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2710 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:58 dist-test-slave-77v9 krb5kdc[10694](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:58 dist-test-slave-77v9 krb5kdc[10694](info): set up 2 sockets
Aug 08 07:06:58 dist-test-slave-77v9 krb5kdc[10694](info): commencing operation
krb5kdc: starting...
W20260808 07:07:00.043582 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:07:00 dist-test-slave-77v9 krb5kdc[10694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:07:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:07:00.236531 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:39005
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:39005
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:00.334685 10707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:00.334942 10707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:00.334967 10707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:00.336257 10707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:00.336330 10707 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 07:07:00.336346 10707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:00.336360 10707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:00.336372 10707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:00.336385 10707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:00.338047 10707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:39005
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:39005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:00.338333 10707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:00.338615 10707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:00.345531 10713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:00.345592 10715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:00.345531 10712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:00.346570 10707 server_base.cc:1034] running on GCE node
I20260808 07:07:00.346972 10707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:00.347373 10707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:00.348589 10707 hybrid_clock.cc:648] HybridClock initialized: now 1786172820348539 us; error 106 us; skew 500 ppm
Aug 08 07:07:00 dist-test-slave-77v9 krb5kdc[10694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172820, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:00.357972 10707 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:07:00.358623 10707 webserver.cc:460] Webserver started at http://127.9.94.62:35853/ using document root <none> and password file <none>
I20260808 07:07:00.358886 10707 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:00.358960 10707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:00.359136 10707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:00.360348 10707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "ddd4b0bc31ee4862a784326f2996755b"
format_stamp: "Formatted at 2026-08-08 07:07:00 on dist-test-slave-77v9"
server_key: "1cc5f97f224fa3291110974c89c0eb82"
server_key_iv: "3a64c41ac3e4b2559d603c7824bd6ce4"
server_key_version: "encryptionkey@0"
I20260808 07:07:00.360771 10707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "ddd4b0bc31ee4862a784326f2996755b"
format_stamp: "Formatted at 2026-08-08 07:07:00 on dist-test-slave-77v9"
server_key: "1cc5f97f224fa3291110974c89c0eb82"
server_key_iv: "3a64c41ac3e4b2559d603c7824bd6ce4"
server_key_version: "encryptionkey@0"
I20260808 07:07:00.362466 10707 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:00.363516 10722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:00.363914 10707 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:00.364012 10707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "ddd4b0bc31ee4862a784326f2996755b"
format_stamp: "Formatted at 2026-08-08 07:07:00 on dist-test-slave-77v9"
server_key: "1cc5f97f224fa3291110974c89c0eb82"
server_key_iv: "3a64c41ac3e4b2559d603c7824bd6ce4"
server_key_version: "encryptionkey@0"
I20260808 07:07:00.364082 10707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:00.398782 10707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:00.402701 10707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:00.402871 10707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:00.411198 10707 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:39005
I20260808 07:07:00.411434 10787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:39005 every 8 connection(s)
I20260808 07:07:00.411780 10707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:00.412685 10788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:00.415181 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 10707
I20260808 07:07:00.415282 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:00.415448 9592 external_mini_cluster.cc:1428] Setting key 36efd355086589033b3abd66a3eac1a8
I20260808 07:07:00.416874 10788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b: Bootstrap starting.
I20260808 07:07:00.417814 10788 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:00.418327 10788 log.cc:824] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:00.419739 10788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b: No bootstrap required, opened a new log
I20260808 07:07:00.422751 10788 raft_consensus.cc:348] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddd4b0bc31ee4862a784326f2996755b" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39005 } }
I20260808 07:07:00.423027 10788 raft_consensus.cc:374] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:00.423081 10788 raft_consensus.cc:729] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd4b0bc31ee4862a784326f2996755b, State: Initialized, Role: FOLLOWER
I20260808 07:07:00.423274 10788 consensus_queue.cc:260] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddd4b0bc31ee4862a784326f2996755b" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39005 } }
I20260808 07:07:00.423400 10788 raft_consensus.cc:388] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:00.423442 10788 raft_consensus.cc:482] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:00.423493 10788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:00.424937 10788 raft_consensus.cc:504] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddd4b0bc31ee4862a784326f2996755b" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39005 } }
Aug 08 07:07:00 dist-test-slave-77v9 krb5kdc[10694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:00.425189 10788 leader_election.cc:302] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ddd4b0bc31ee4862a784326f2996755b; no voters:
I20260808 07:07:00.425686 10788 leader_election.cc:288] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:00.425729 10793 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:00.426167 10793 raft_consensus.cc:686] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [term 1 LEADER]: Becoming Leader. State: Replica: ddd4b0bc31ee4862a784326f2996755b, State: Running, Role: LEADER
I20260808 07:07:00.426342 10788 sys_catalog.cc:564] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:00.426402 10793 consensus_queue.cc:237] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddd4b0bc31ee4862a784326f2996755b" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39005 } }
I20260808 07:07:00.427055 10795 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ddd4b0bc31ee4862a784326f2996755b. Latest consensus state: current_term: 1 leader_uuid: "ddd4b0bc31ee4862a784326f2996755b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddd4b0bc31ee4862a784326f2996755b" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39005 } } }
I20260808 07:07:00.427749 10795 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:00.427644 10794 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ddd4b0bc31ee4862a784326f2996755b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddd4b0bc31ee4862a784326f2996755b" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39005 } } }
I20260808 07:07:00.428056 10794 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b [sys.catalog]: This master's current role is: LEADER
W20260808 07:07:00.429329 10809 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:07:00.429445 10809 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:07:00.429522 10802 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:00.429690 10802 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:00.430573 10791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:00.416387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35974 (local address 127.9.94.62:39005)
0808 07:07:00.416759 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:00.416769 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:00.416840 (+ 71us) server_negotiation.cc:407] Connection header received
0808 07:07:00.417708 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:00.417730 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:00.417796 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:00.418090 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:00.419309 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.420347 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.421696 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.422244 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.422351 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:00.425703 (+ 3352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:00.425707 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:00.425708 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:00.425721 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:00.428722 (+ 3001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:00.429202 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:00.429205 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:00.429206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:00.429313 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:00.429541 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:00.429542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:00.429542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:00.429885 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:00.430005 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:00.430190 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 07:07:00.430309 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":182,"threads_started":1}
I20260808 07:07:00.431819 10802 catalog_manager.cc:1347] Generated new cluster ID: e7c1f49f154e48d0b42be97303f87241
I20260808 07:07:00.431876 10802 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:00.437907 10802 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:00.438544 10802 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:00.444659 10802 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b: Generated new TSK 0
I20260808 07:07:00.445072 10802 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:07:00.494958 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39005
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:00.622428 10814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:00.622953 10814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:00.623020 10814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:00.625066 10814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:00.625296 10814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:00.625469 10814 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:07:00.625543 10814 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:00.628813 10814 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.94.62:39005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:00.629227 10814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:00.629573 10814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:00.638257 10821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:00.638495 10814 server_base.cc:1034] running on GCE node
W20260808 07:07:00.638245 10819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:00.638319 10823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:00.639070 10814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:00.639448 10814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:00.640647 10814 hybrid_clock.cc:648] HybridClock initialized: now 1786172820640608 us; error 68 us; skew 500 ppm
Aug 08 07:07:00 dist-test-slave-77v9 krb5kdc[10694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172820, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:00.644387 10814 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:07:00.645036 10814 webserver.cc:460] Webserver started at http://127.9.94.1:46559/ using document root <none> and password file <none>
I20260808 07:07:00.645543 10814 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:00.645627 10814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:00.645804 10814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:00.647367 10814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "147a6b3fabce4f20a1e64794b49b0a06"
format_stamp: "Formatted at 2026-08-08 07:07:00 on dist-test-slave-77v9"
server_key: "6db004ffb20324fdc795081a4b1461bc"
server_key_iv: "da499f9c771f11f91d1dc326ae5abc63"
server_key_version: "encryptionkey@0"
I20260808 07:07:00.647814 10814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "147a6b3fabce4f20a1e64794b49b0a06"
format_stamp: "Formatted at 2026-08-08 07:07:00 on dist-test-slave-77v9"
server_key: "6db004ffb20324fdc795081a4b1461bc"
server_key_iv: "da499f9c771f11f91d1dc326ae5abc63"
server_key_version: "encryptionkey@0"
I20260808 07:07:00.650610 10814 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.005s
I20260808 07:07:00.652026 10831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:00.652400 10814 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:00.652544 10814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "147a6b3fabce4f20a1e64794b49b0a06"
format_stamp: "Formatted at 2026-08-08 07:07:00 on dist-test-slave-77v9"
server_key: "6db004ffb20324fdc795081a4b1461bc"
server_key_iv: "da499f9c771f11f91d1dc326ae5abc63"
server_key_version: "encryptionkey@0"
I20260808 07:07:00.652647 10814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:00.673053 10814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:00.676383 10814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:00.676626 10814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:00.677448 10814 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:00.677525 10814 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:00.677572 10814 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:00.677600 10814 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:07:00 dist-test-slave-77v9 krb5kdc[10694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172820, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:00.688035 10814 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:40487
I20260808 07:07:00.688190 10949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:40487 every 8 connection(s)
I20260808 07:07:00.688481 10814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:07:00.693845 10791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:00.678722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:48541 (local address 127.9.94.62:39005)
0808 07:07:00.678883 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:00.678885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:00.679190 (+ 305us) server_negotiation.cc:407] Connection header received
0808 07:07:00.679857 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:00.679858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:00.679873 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:00.679972 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:00.681982 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.682901 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.684858 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.685098 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.685189 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:00.689103 (+ 3914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:00.689106 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:00.689107 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:00.689119 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:00.691143 (+ 2024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:00.692119 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:00.692121 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:00.692121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:00.692202 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:00.692534 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:00.692535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:00.692535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:00.692667 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:00.692736 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:00.693456 (+ 720us) server_negotiation.cc:299] Negotiation successful
0808 07:07:00.693768 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125}
I20260808 07:07:00.693904 10840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:00.678668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39005 (local address 127.9.94.1:48541)
0808 07:07:00.679028 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:00.679080 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:00.679713 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:00.680167 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:00.680176 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:00.681053 (+ 877us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:00.681647 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:00.681659 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.683057 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.683059 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:00.684693 (+ 1634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:00.684697 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.685233 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.685234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:00.685433 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:00.686397 (+ 964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:00.686409 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:00.688862 (+ 2453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:00.691320 (+ 2458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:00.691335 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:00.691339 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:00.691938 (+ 599us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:00.692317 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:00.692318 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:00.692318 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:00.692449 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:00.692907 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:00.692921 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:00.693187 (+ 266us) client_negotiation.cc:769] Sending connection context
0808 07:07:00.693352 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 07:07:00.693646 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":223,"threads_started":1}
I20260808 07:07:00.694718 10950 heartbeater.cc:347] Connected to a master server at 127.9.94.62:39005
I20260808 07:07:00.694873 10950 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:00.695134 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 10814
I20260808 07:07:00.695184 10950 heartbeater.cc:511] Master 127.9.94.62:39005 requested a full tablet report, sending...
I20260808 07:07:00.695261 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:00.695458 9592 external_mini_cluster.cc:1428] Setting key 479a2ed598290ed7edbf2230613e4b96
I20260808 07:07:00.696060 10737 ts_manager.cc:194] Registered new tserver with Master: 147a6b3fabce4f20a1e64794b49b0a06 (127.9.94.1:40487)
I20260808 07:07:00.697273 10737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:48541
I20260808 07:07:00.704639 10956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:00.696384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39005 (local address 127.9.94.1:57057)
0808 07:07:00.696563 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:00.696577 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:00.696640 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:00.697226 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:00.697228 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:00.697686 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:00.697785 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:00.697788 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.699146 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.699148 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:00.699755 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:00.699758 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.700228 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.700229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:00.700326 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:00.700960 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:00.700965 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:00.701352 (+ 387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:00.703356 (+ 2004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:00.703358 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:00.703358 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:00.703568 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:00.703814 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:00.703815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:00.703815 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:00.703890 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:00.704187 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:00.704188 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:00.704259 (+ 71us) client_negotiation.cc:769] Sending connection context
0808 07:07:00.704355 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 07:07:00.704499 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":88,"threads_started":1}
I20260808 07:07:00.704629 10791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:00.696565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:57057 (local address 127.9.94.62:39005)
0808 07:07:00.696606 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:00.696608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:00.696623 (+ 15us) server_negotiation.cc:407] Connection header received
0808 07:07:00.696797 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:00.696798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:00.696934 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:00.697014 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:00.698068 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.698928 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.699892 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.700139 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.700228 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:00.701489 (+ 1261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:00.701490 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:00.701491 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:00.701499 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:00.703226 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:00.703655 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:00.703657 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:00.703657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:00.703728 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:00.703971 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:00.703972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:00.703973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:00.704109 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:00.704196 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:00.704436 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 07:07:00.704525 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:07:00.746601 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39005
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:00.858071 10960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:00.858354 10960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:00.858385 10960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:00.859740 10960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:00.859794 10960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:00.859819 10960 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:07:00.859840 10960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:00.862743 10960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.94.62:39005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:00.863474 10960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:00.863822 10960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:00.870601 10968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:00.870605 10966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:00.870601 10965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:00.870975 10960 server_base.cc:1034] running on GCE node
I20260808 07:07:00.871196 10960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:00.871517 10960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:00.872749 10960 hybrid_clock.cc:648] HybridClock initialized: now 1786172820872693 us; error 86 us; skew 500 ppm
Aug 08 07:07:00 dist-test-slave-77v9 krb5kdc[10694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172820, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:00.878453 10960 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:07:00.879325 10960 webserver.cc:460] Webserver started at http://127.9.94.2:39667/ using document root <none> and password file <none>
I20260808 07:07:00.879698 10960 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:00.879797 10960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:00.880158 10960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:00.882120 10960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "44ab3022aaa54e2580292a9d604e629f"
format_stamp: "Formatted at 2026-08-08 07:07:00 on dist-test-slave-77v9"
server_key: "324b07a2554e8c70e6ff634249fafb92"
server_key_iv: "1485c8b8a673253623e0dc5a36cdc6fb"
server_key_version: "encryptionkey@0"
I20260808 07:07:00.883222 10960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "44ab3022aaa54e2580292a9d604e629f"
format_stamp: "Formatted at 2026-08-08 07:07:00 on dist-test-slave-77v9"
server_key: "324b07a2554e8c70e6ff634249fafb92"
server_key_iv: "1485c8b8a673253623e0dc5a36cdc6fb"
server_key_version: "encryptionkey@0"
I20260808 07:07:00.885361 10960 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260808 07:07:00.886722 10975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:00.887290 10960 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:00.887531 10960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "44ab3022aaa54e2580292a9d604e629f"
format_stamp: "Formatted at 2026-08-08 07:07:00 on dist-test-slave-77v9"
server_key: "324b07a2554e8c70e6ff634249fafb92"
server_key_iv: "1485c8b8a673253623e0dc5a36cdc6fb"
server_key_version: "encryptionkey@0"
I20260808 07:07:00.888044 10960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:00.906580 10960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:00.910066 10960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:00.910324 10960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:00.911420 10960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:00.911542 10960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:00.911597 10960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:00.911612 10960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:07:00 dist-test-slave-77v9 krb5kdc[10694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172820, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:00.919782 10960 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:36487
I20260808 07:07:00.919872 11092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:36487 every 8 connection(s)
I20260808 07:07:00.920210 10960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:07:00.922643 10791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:00.912048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:50031 (local address 127.9.94.62:39005)
0808 07:07:00.912128 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:00.912131 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:00.912412 (+ 281us) server_negotiation.cc:407] Connection header received
0808 07:07:00.913166 (+ 754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:00.913168 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:00.913182 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:00.913277 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:00.914037 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.914649 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.915819 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.916192 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.916297 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:00.918997 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:00.919000 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:00.919000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:00.919010 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:00.921070 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:00.921537 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:00.921539 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:00.921539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:00.921610 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:00.921996 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:00.921997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:00.921997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:00.922122 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:00.922181 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:00.922488 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 07:07:00.922570 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 07:07:00.922845 10984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:00.912045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39005 (local address 127.9.94.2:50031)
0808 07:07:00.912253 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:00.912302 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:00.913053 (+ 751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:00.913346 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:00.913350 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:00.913668 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:00.913906 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:00.913910 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.914763 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.914764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:00.915689 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:00.915691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.916307 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.916308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:00.916506 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:00.917209 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:00.917219 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:00.918873 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:00.921195 (+ 2322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:00.921201 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:00.921202 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:00.921439 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:00.921712 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:00.921713 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:00.921714 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:00.921898 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:00.922185 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:00.922189 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:00.922327 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 07:07:00.922419 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 07:07:00.922558 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":125,"threads_started":1}
I20260808 07:07:00.923480 11093 heartbeater.cc:347] Connected to a master server at 127.9.94.62:39005
I20260808 07:07:00.923576 11093 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:00.923789 11093 heartbeater.cc:511] Master 127.9.94.62:39005 requested a full tablet report, sending...
I20260808 07:07:00.924245 10737 ts_manager.cc:194] Registered new tserver with Master: 44ab3022aaa54e2580292a9d604e629f (127.9.94.2:36487)
I20260808 07:07:00.924891 10737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:50031
I20260808 07:07:00.926066 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 10960
I20260808 07:07:00.926158 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:07:00.926366 9592 external_mini_cluster.cc:1428] Setting key 18612d887f64a65accd5496863d0d1b8
I20260808 07:07:00.933893 10791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:00.924750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:48279 (local address 127.9.94.62:39005)
0808 07:07:00.924799 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:00.924801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:00.925164 (+ 363us) server_negotiation.cc:407] Connection header received
0808 07:07:00.925246 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:00.925246 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:00.925257 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:00.925418 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:00.925767 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.926542 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.927536 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.927896 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.927980 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:00.929360 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:00.929362 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:00.929362 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:00.929370 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:00.931605 (+ 2235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:00.932068 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:00.932069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:00.932070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:00.932137 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:00.932799 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:00.932800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:00.932800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:00.933082 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:00.933167 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:00.933513 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 07:07:00.933624 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:07:00.933784 11099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:00.924633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39005 (local address 127.9.94.2:48279)
0808 07:07:00.925082 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:00.925096 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:00.925181 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:00.925428 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:00.925429 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:00.925613 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:00.925684 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:00.925686 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.926629 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.926630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:00.927449 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:00.927452 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:00.927978 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:00.927979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:00.928066 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:00.928704 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:00.928710 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:00.929240 (+ 530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:00.931740 (+ 2500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:00.931741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:00.931741 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:00.931966 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:00.932352 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:00.932356 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:00.932357 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:00.932534 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:00.933209 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:00.933211 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:00.933266 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 07:07:00.933449 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 07:07:00.933655 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":77,"threads_started":1}
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:07:00.971421 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39005
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:01.071681 11102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:01.071957 11102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:01.071990 11102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:01.073438 11102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:01.073493 11102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:01.073518 11102 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:07:01.073539 11102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:01.075253 11102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.94.62:39005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:01.075521 11102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:01.075752 11102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:01.082988 11108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:01.083000 11110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:01.083092 11107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:01.083386 11102 server_base.cc:1034] running on GCE node
I20260808 07:07:01.083729 11102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:01.084357 11102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:01.085621 11102 hybrid_clock.cc:648] HybridClock initialized: now 1786172821085568 us; error 70 us; skew 500 ppm
Aug 08 07:07:01 dist-test-slave-77v9 krb5kdc[10694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172821, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:01.088961 11102 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:07:01.089607 11102 webserver.cc:460] Webserver started at http://127.9.94.3:37081/ using document root <none> and password file <none>
I20260808 07:07:01.089922 11102 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:01.090000 11102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:01.090165 11102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:01.091670 11102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "34ab04420400434f978bd23d52c5184e"
format_stamp: "Formatted at 2026-08-08 07:07:01 on dist-test-slave-77v9"
server_key: "b0769c9dac7ae2fae72f332ea4a2daa6"
server_key_iv: "aa0df9f3b4d533978c5bd13ce8f081dd"
server_key_version: "encryptionkey@0"
I20260808 07:07:01.092079 11102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "34ab04420400434f978bd23d52c5184e"
format_stamp: "Formatted at 2026-08-08 07:07:01 on dist-test-slave-77v9"
server_key: "b0769c9dac7ae2fae72f332ea4a2daa6"
server_key_iv: "aa0df9f3b4d533978c5bd13ce8f081dd"
server_key_version: "encryptionkey@0"
I20260808 07:07:01.094040 11102 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 07:07:01.095417 11117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:01.096009 11102 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:01.096109 11102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "34ab04420400434f978bd23d52c5184e"
format_stamp: "Formatted at 2026-08-08 07:07:01 on dist-test-slave-77v9"
server_key: "b0769c9dac7ae2fae72f332ea4a2daa6"
server_key_iv: "aa0df9f3b4d533978c5bd13ce8f081dd"
server_key_version: "encryptionkey@0"
I20260808 07:07:01.096168 11102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:01.113509 11102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:01.117115 11102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:01.117365 11102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:01.118113 11102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:01.118175 11102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:01.118283 11102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:01.118350 11102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:07:01 dist-test-slave-77v9 krb5kdc[10694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172821, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:01.126950 11102 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:42163
I20260808 07:07:01.127040 11236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:42163 every 8 connection(s)
I20260808 07:07:01.127471 11102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:07:01.129526 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 11102
I20260808 07:07:01.129660 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:07:01.129863 9592 external_mini_cluster.cc:1428] Setting key 9a5cb6b78650c8d0cd0519048e88f08c
I20260808 07:07:01.131215 10791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.118626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:38713 (local address 127.9.94.62:39005)
0808 07:07:01.118684 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.118687 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.119527 (+ 840us) server_negotiation.cc:407] Connection header received
0808 07:07:01.120280 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.120281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.120297 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.120348 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:01.121417 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.121963 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.123048 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.123263 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.123343 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.126852 (+ 3509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:01.126854 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:01.126854 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:01.126862 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:01.129133 (+ 2271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:01.129704 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:01.129705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:01.129706 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:01.129787 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:01.130207 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:01.130208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:01.130209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:01.130445 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:01.130523 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.130991 (+ 468us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.131112 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:07:01.131529 11126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.118620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39005 (local address 127.9.94.3:38713)
0808 07:07:01.119369 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:01.119412 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:01.120149 (+ 737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:01.120621 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:01.120625 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:01.121078 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:01.121306 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.121310 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.122067 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.122068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.122932 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.122935 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.123351 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.123352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.123522 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.124270 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:01.124282 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:01.126712 (+ 2430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:01.129276 (+ 2564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:01.129283 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:01.129285 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:01.129558 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:01.129871 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:01.129872 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:01.129872 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:01.130087 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:01.130525 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:01.130533 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:01.130854 (+ 321us) client_negotiation.cc:769] Sending connection context
0808 07:07:01.130982 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 07:07:01.131223 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":195,"threads_started":1}
I20260808 07:07:01.132133 11237 heartbeater.cc:347] Connected to a master server at 127.9.94.62:39005
I20260808 07:07:01.132220 11237 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:01.132419 11237 heartbeater.cc:511] Master 127.9.94.62:39005 requested a full tablet report, sending...
I20260808 07:07:01.132880 10737 ts_manager.cc:194] Registered new tserver with Master: 34ab04420400434f978bd23d52c5184e (127.9.94.3:42163)
I20260808 07:07:01.133621 10737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:38713
I20260808 07:07:01.141007 10791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.133458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:46779 (local address 127.9.94.62:39005)
0808 07:07:01.133550 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.133552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.133838 (+ 286us) server_negotiation.cc:407] Connection header received
0808 07:07:01.133943 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.133945 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.133956 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.134015 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:01.134585 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.135171 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.135989 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.136197 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.136269 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.137618 (+ 1349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:01.137619 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:01.137620 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:01.137626 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:01.139479 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:01.139939 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:01.139941 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:01.139941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:01.140005 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:01.140267 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:01.140268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:01.140268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:01.140446 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:01.140525 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.140771 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.140934 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 07:07:01.141017 11243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.133521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39005 (local address 127.9.94.3:46779)
0808 07:07:01.133720 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:01.133734 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:01.133873 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:01.134059 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:01.134060 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:01.134326 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:01.134425 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.134427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.135340 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.135341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.135888 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.135890 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.136328 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.136329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.136397 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.137108 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:01.137113 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:01.137442 (+ 329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:01.139587 (+ 2145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:01.139588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:01.139588 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:01.139798 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:01.140094 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:01.140094 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:01.140095 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:01.140160 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:01.140561 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:01.140563 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:01.140610 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 07:07:01.140695 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 07:07:01.140893 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":82,"threads_started":1}
I20260808 07:07:01.142539 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 07:07:01 dist-test-slave-77v9 krb5kdc[10694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172821, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 07:07:01 dist-test-slave-77v9 krb5kdc[10694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172821, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:01.175097 10791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.164306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35986 (local address 127.9.94.62:39005)
0808 07:07:01.164387 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.164390 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.164400 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:07:01.164482 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.164483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.164494 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.164542 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:01.165408 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.165965 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.167149 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.167394 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.167513 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.170801 (+ 3288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:01.170803 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:01.170804 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:01.170817 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:01.173027 (+ 2210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:01.173934 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:01.173935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:01.173935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:01.174012 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:01.174333 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:01.174333 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:01.174334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:01.174499 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:01.174610 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.174925 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.175019 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 07:07:01.178108 10737 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35986:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:07:01.180356 10737 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:01.187636 11256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.183506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54180 (local address 127.9.94.2:36487)
0808 07:07:01.183726 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.183732 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.183744 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:07:01.183786 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.183788 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.183806 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.183921 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:01.184211 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.185099 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.186399 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.187155 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.187257 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.187322 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.187485 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.187525 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":115,"threads_started":1}
I20260808 07:07:01.187625 11254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.183255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:36487 (local address 127.0.0.1:54180)
0808 07:07:01.183399 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:01.183439 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:01.183508 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:01.183934 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:01.183937 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:01.183940 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:01.184118 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.184121 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.185186 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.185187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.186299 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.186302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.187265 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.187266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.187359 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.187372 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 07:07:01.187466 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 07:07:01.187526 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":94,"threads_started":1}
I20260808 07:07:01.188261 11255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.183574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:42163 (local address 127.0.0.1:40916)
0808 07:07:01.184004 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:01.184016 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:01.184072 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:01.184332 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:01.184333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:01.184335 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:01.184367 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.184369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.185809 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.185810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.186966 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.186969 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.187940 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.187941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.188010 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.188017 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 07:07:01.188068 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 07:07:01.188119 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":113,"thread_start_us":76,"threads_started":1}
I20260808 07:07:01.188309 11259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.183724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40916 (local address 127.9.94.3:42163)
0808 07:07:01.183947 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.183952 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.184134 (+ 182us) server_negotiation.cc:407] Connection header received
0808 07:07:01.184177 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.184179 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.184195 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.184269 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:01.184475 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.185710 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.187090 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.187776 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.187844 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.187906 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.188164 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.188208 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":103,"threads_started":1}
I20260808 07:07:01.188361 11258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.183738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50412 (local address 127.9.94.1:40487)
0808 07:07:01.183986 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.183990 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.184003 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:07:01.184055 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.184057 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.184075 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.184344 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:01.184402 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.185680 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.187040 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.187769 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.187844 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.187897 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.188206 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.188253 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":64,"threads_started":1}
I20260808 07:07:01.188494 11257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.183284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:40487 (local address 127.0.0.1:50412)
0808 07:07:01.183723 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:01.183735 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:01.183796 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:01.184192 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:01.184193 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:01.184195 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:01.184262 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.184264 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.185792 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.185793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.186941 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.186944 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.187938 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.187940 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.188010 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.188015 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:07:01.188068 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 07:07:01.188119 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":45,"thread_start_us":147,"threads_started":1}
I20260808 07:07:01.188748 11025 tablet_service.cc:1467] Processing CreateTablet for tablet 15e9039bfee94c3fab39a65748e0f82d (DEFAULT_TABLE table=test-table [id=508331bd23704a3fb62a5b54024e60a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:01.189183 11025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15e9039bfee94c3fab39a65748e0f82d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:01.189368 10882 tablet_service.cc:1467] Processing CreateTablet for tablet 15e9039bfee94c3fab39a65748e0f82d (DEFAULT_TABLE table=test-table [id=508331bd23704a3fb62a5b54024e60a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:01.189666 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15e9039bfee94c3fab39a65748e0f82d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:01.192597 11261 tablet_bootstrap.cc:492] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06: Bootstrap starting.
I20260808 07:07:01.192574 11260 tablet_bootstrap.cc:492] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f: Bootstrap starting.
I20260808 07:07:01.192476 11167 tablet_service.cc:1467] Processing CreateTablet for tablet 15e9039bfee94c3fab39a65748e0f82d (DEFAULT_TABLE table=test-table [id=508331bd23704a3fb62a5b54024e60a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:01.192937 11167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15e9039bfee94c3fab39a65748e0f82d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:01.193735 11260 tablet_bootstrap.cc:654] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:01.194027 11261 tablet_bootstrap.cc:654] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:01.194195 11260 log.cc:824] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:01.194401 11261 log.cc:824] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:01.195331 11261 tablet_bootstrap.cc:492] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06: No bootstrap required, opened a new log
I20260808 07:07:01.195408 11260 tablet_bootstrap.cc:492] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f: No bootstrap required, opened a new log
I20260808 07:07:01.195439 11261 ts_tablet_manager.cc:1397] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:07:01.195511 11260 ts_tablet_manager.cc:1397] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:07:01.196625 11264 tablet_bootstrap.cc:492] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e: Bootstrap starting.
I20260808 07:07:01.197769 11264 tablet_bootstrap.cc:654] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:01.197816 11261 raft_consensus.cc:348] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } }
I20260808 07:07:01.197932 11260 raft_consensus.cc:348] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } }
I20260808 07:07:01.198068 11261 raft_consensus.cc:374] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:01.198127 11261 raft_consensus.cc:729] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 147a6b3fabce4f20a1e64794b49b0a06, State: Initialized, Role: FOLLOWER
I20260808 07:07:01.198172 11260 raft_consensus.cc:374] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:01.198173 11264 log.cc:824] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:01.198220 11260 raft_consensus.cc:729] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44ab3022aaa54e2580292a9d604e629f, State: Initialized, Role: FOLLOWER
I20260808 07:07:01.198285 11261 consensus_queue.cc:260] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } }
I20260808 07:07:01.198360 11260 consensus_queue.cc:260] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } }
I20260808 07:07:01.198581 11261 ts_tablet_manager.cc:1428] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:07:01.198632 10950 heartbeater.cc:503] Master 127.9.94.62:39005 was elected leader, sending a full tablet report...
I20260808 07:07:01.198662 11260 ts_tablet_manager.cc:1428] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:07:01.198976 11093 heartbeater.cc:503] Master 127.9.94.62:39005 was elected leader, sending a full tablet report...
I20260808 07:07:01.199311 11264 tablet_bootstrap.cc:492] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e: No bootstrap required, opened a new log
I20260808 07:07:01.199398 11264 ts_tablet_manager.cc:1397] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:07:01.201620 11264 raft_consensus.cc:348] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } }
I20260808 07:07:01.201809 11264 raft_consensus.cc:374] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:01.201861 11264 raft_consensus.cc:729] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34ab04420400434f978bd23d52c5184e, State: Initialized, Role: FOLLOWER
I20260808 07:07:01.201992 11264 consensus_queue.cc:260] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } }
I20260808 07:07:01.202294 11264 ts_tablet_manager.cc:1428] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:07:01.202356 11237 heartbeater.cc:503] Master 127.9.94.62:39005 was elected leader, sending a full tablet report...
I20260808 07:07:01.209640 11266 raft_consensus.cc:482] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:01.209811 11266 raft_consensus.cc:504] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } }
I20260808 07:07:01.210280 11266 leader_election.cc:288] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34ab04420400434f978bd23d52c5184e (127.9.94.3:42163), 44ab3022aaa54e2580292a9d604e629f (127.9.94.2:36487)
I20260808 07:07:01.214197 11259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.210606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:34973 (local address 127.9.94.3:42163)
0808 07:07:01.210665 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.210668 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.210782 (+ 114us) server_negotiation.cc:407] Connection header received
0808 07:07:01.210826 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.210827 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.210841 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.210897 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:01.211099 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.211695 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.213216 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.213773 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.213883 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.213898 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.214077 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.214118 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:07:01.214222 11270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.210527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:42163 (local address 127.9.94.1:34973)
0808 07:07:01.210684 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:01.210695 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:01.210772 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:01.210910 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:01.210911 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:01.210913 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:01.211013 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.211015 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.211797 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.211798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.213118 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.213126 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.213901 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.213903 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.213976 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.213992 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 07:07:01.214068 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 07:07:01.214113 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":53,"threads_started":1}
I20260808 07:07:01.214461 11256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.210614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:53645 (local address 127.9.94.2:36487)
0808 07:07:01.210662 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.210665 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.210717 (+ 52us) server_negotiation.cc:407] Connection header received
0808 07:07:01.210844 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.210845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.210856 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.210931 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:01.211247 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.211779 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.213407 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.214055 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.214105 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.214116 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.214334 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.214378 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:07:01.214473 11269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.210477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:36487 (local address 127.9.94.1:53645)
0808 07:07:01.210644 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:01.210659 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:01.210741 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:01.211011 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:01.211012 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:01.211013 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:01.211124 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.211126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.211949 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.211950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.213283 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.213287 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.214188 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.214189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.214250 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.214253 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:01.214328 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 07:07:01.214376 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":95,"threads_started":1}
I20260808 07:07:01.214938 11184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15e9039bfee94c3fab39a65748e0f82d" candidate_uuid: "147a6b3fabce4f20a1e64794b49b0a06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34ab04420400434f978bd23d52c5184e" is_pre_election: true
I20260808 07:07:01.214957 11046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15e9039bfee94c3fab39a65748e0f82d" candidate_uuid: "147a6b3fabce4f20a1e64794b49b0a06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ab3022aaa54e2580292a9d604e629f" is_pre_election: true
I20260808 07:07:01.215118 11046 raft_consensus.cc:2454] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 147a6b3fabce4f20a1e64794b49b0a06 in term 0.
I20260808 07:07:01.215116 11184 raft_consensus.cc:2454] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 147a6b3fabce4f20a1e64794b49b0a06 in term 0.
I20260808 07:07:01.215377 10832 leader_election.cc:302] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 147a6b3fabce4f20a1e64794b49b0a06, 44ab3022aaa54e2580292a9d604e629f; no voters:
I20260808 07:07:01.215574 11266 raft_consensus.cc:2781] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:01.215669 11266 raft_consensus.cc:482] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:01.215711 11266 raft_consensus.cc:3037] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:01.216584 11266 raft_consensus.cc:504] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } }
I20260808 07:07:01.216771 11266 leader_election.cc:288] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [CANDIDATE]: Term 1 election: Requested vote from peers 34ab04420400434f978bd23d52c5184e (127.9.94.3:42163), 44ab3022aaa54e2580292a9d604e629f (127.9.94.2:36487)
I20260808 07:07:01.216943 11184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15e9039bfee94c3fab39a65748e0f82d" candidate_uuid: "147a6b3fabce4f20a1e64794b49b0a06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34ab04420400434f978bd23d52c5184e"
I20260808 07:07:01.217027 11184 raft_consensus.cc:3037] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:01.217088 11046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15e9039bfee94c3fab39a65748e0f82d" candidate_uuid: "147a6b3fabce4f20a1e64794b49b0a06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ab3022aaa54e2580292a9d604e629f"
I20260808 07:07:01.217160 11046 raft_consensus.cc:3037] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:01.217972 11184 raft_consensus.cc:2454] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 147a6b3fabce4f20a1e64794b49b0a06 in term 1.
I20260808 07:07:01.218053 11046 raft_consensus.cc:2454] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 147a6b3fabce4f20a1e64794b49b0a06 in term 1.
I20260808 07:07:01.218231 10832 leader_election.cc:302] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 147a6b3fabce4f20a1e64794b49b0a06, 44ab3022aaa54e2580292a9d604e629f; no voters:
I20260808 07:07:01.218341 11266 raft_consensus.cc:2781] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:01.218608 11266 raft_consensus.cc:686] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [term 1 LEADER]: Becoming Leader. State: Replica: 147a6b3fabce4f20a1e64794b49b0a06, State: Running, Role: LEADER
I20260808 07:07:01.218775 11266 consensus_queue.cc:237] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } }
I20260808 07:07:01.220386 10737 catalog_manager.cc:5495] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 147a6b3fabce4f20a1e64794b49b0a06 (127.9.94.1). New cstate: current_term: 1 leader_uuid: "147a6b3fabce4f20a1e64794b49b0a06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } health_report { overall_health: UNKNOWN } } }
I20260808 07:07:01.231361 11258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.227630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50422 (local address 127.9.94.1:40487)
0808 07:07:01.227709 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.227711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.227723 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:07:01.228087 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.228091 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.228215 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.228536 (+ 321us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:01.228742 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.229422 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.230356 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.230591 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.230679 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.230936 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:01.231058 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:01.231159 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.231227 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.231253 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 07:07:01.233980 11046 raft_consensus.cc:1261] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f [term 1 FOLLOWER]: Refusing update from remote peer 147a6b3fabce4f20a1e64794b49b0a06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:01.234136 11184 raft_consensus.cc:1261] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e [term 1 FOLLOWER]: Refusing update from remote peer 147a6b3fabce4f20a1e64794b49b0a06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:01.234658 11266 consensus_queue.cc:1035] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:01.234961 11271 consensus_queue.cc:1035] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:01.238847 11275 mvcc.cc:205] Tried to move back new op lower bound from 7316163875769995264 to 7316163875713167360. Current Snapshot: MvccSnapshot[applied={T|T < 7316163875769995264}]
I20260808 07:07:01.244004 10736 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:01.244134 10736 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:01.245764 10736 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b: Sending DeleteTablet for 3 replicas of tablet 15e9039bfee94c3fab39a65748e0f82d
I20260808 07:07:01.246213 10882 tablet_service.cc:1514] Processing DeleteTablet for tablet 15e9039bfee94c3fab39a65748e0f82d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:01 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:50412
I20260808 07:07:01.246250 11025 tablet_service.cc:1514] Processing DeleteTablet for tablet 15e9039bfee94c3fab39a65748e0f82d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:01 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:54180
I20260808 07:07:01.246557 11167 tablet_service.cc:1514] Processing DeleteTablet for tablet 15e9039bfee94c3fab39a65748e0f82d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:01 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:40916
I20260808 07:07:01.246620 11283 tablet_replica.cc:330] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f: stopping tablet replica
I20260808 07:07:01.246767 11283 raft_consensus.cc:2229] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:01.246914 11283 raft_consensus.cc:2258] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:01.247100 11284 tablet_replica.cc:330] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06: stopping tablet replica
I20260808 07:07:01.247210 11284 raft_consensus.cc:2229] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:07:01.247260 11285 tablet_replica.cc:330] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e: stopping tablet replica
I20260808 07:07:01.247234 10736 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35986:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 07:07:01.247346 11284 raft_consensus.cc:2258] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 07:07:01.247413 10736 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:01.247499 11285 raft_consensus.cc:2229] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:01.247649 11285 raft_consensus.cc:2258] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:01.247920 11283 ts_tablet_manager.cc:1905] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:01.248646 11285 ts_tablet_manager.cc:1905] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:01.249763 10882 tablet_service.cc:1467] Processing CreateTablet for tablet 07378a2babbf4c86b78c9abce0630536 (DEFAULT_TABLE table=test-table [id=fa9e5ecaf7894aa192cb56c77d85ef16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:01.249819 11025 tablet_service.cc:1467] Processing CreateTablet for tablet 07378a2babbf4c86b78c9abce0630536 (DEFAULT_TABLE table=test-table [id=fa9e5ecaf7894aa192cb56c77d85ef16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:01.249908 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07378a2babbf4c86b78c9abce0630536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:01.249953 11025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07378a2babbf4c86b78c9abce0630536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:01.251394 11261 tablet_bootstrap.cc:492] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06: Bootstrap starting.
I20260808 07:07:01.251436 11260 tablet_bootstrap.cc:492] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f: Bootstrap starting.
I20260808 07:07:01.251869 11261 tablet_bootstrap.cc:654] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:01.251871 11260 tablet_bootstrap.cc:654] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:01.252339 11285 ts_tablet_manager.cc:1918] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:01.252561 11167 tablet_service.cc:1467] Processing CreateTablet for tablet 07378a2babbf4c86b78c9abce0630536 (DEFAULT_TABLE table=test-table [id=fa9e5ecaf7894aa192cb56c77d85ef16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:01.252684 11167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07378a2babbf4c86b78c9abce0630536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:01.252921 11260 tablet_bootstrap.cc:492] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f: No bootstrap required, opened a new log
I20260808 07:07:01.252971 11260 ts_tablet_manager.cc:1397] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:07:01.253142 11260 raft_consensus.cc:348] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.253223 11260 raft_consensus.cc:374] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:01.253247 11260 raft_consensus.cc:729] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44ab3022aaa54e2580292a9d604e629f, State: Initialized, Role: FOLLOWER
I20260808 07:07:01.253301 11260 consensus_queue.cc:260] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.253402 11260 ts_tablet_manager.cc:1428] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:01.254227 11264 tablet_bootstrap.cc:492] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e: Bootstrap starting.
I20260808 07:07:01.254936 11264 tablet_bootstrap.cc:654] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:01.256062 11264 tablet_bootstrap.cc:492] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e: No bootstrap required, opened a new log
I20260808 07:07:01.256126 11264 ts_tablet_manager.cc:1397] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:07:01.256294 11264 raft_consensus.cc:348] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.256392 11264 raft_consensus.cc:374] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:01.256428 11264 raft_consensus.cc:729] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34ab04420400434f978bd23d52c5184e, State: Initialized, Role: FOLLOWER
I20260808 07:07:01.256484 11264 consensus_queue.cc:260] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.256601 11264 ts_tablet_manager.cc:1428] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:01.256688 11261 tablet_bootstrap.cc:492] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06: No bootstrap required, opened a new log
I20260808 07:07:01.256791 11261 ts_tablet_manager.cc:1397] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 07:07:01.257053 11261 raft_consensus.cc:348] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.257179 11261 raft_consensus.cc:374] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:01.257210 11261 raft_consensus.cc:729] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 147a6b3fabce4f20a1e64794b49b0a06, State: Initialized, Role: FOLLOWER
I20260808 07:07:01.257274 11261 consensus_queue.cc:260] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.257398 11261 ts_tablet_manager.cc:1428] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:01.257514 11284 ts_tablet_manager.cc:1905] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:01.258376 11285 log.cc:1196] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/15e9039bfee94c3fab39a65748e0f82d
I20260808 07:07:01.258963 11285 ts_tablet_manager.cc:1939] T 15e9039bfee94c3fab39a65748e0f82d P 34ab04420400434f978bd23d52c5184e: Deleting consensus metadata
I20260808 07:07:01.259475 11283 ts_tablet_manager.cc:1918] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:01.259720 10724 catalog_manager.cc:4841] TS 34ab04420400434f978bd23d52c5184e (127.9.94.3:42163): tablet 15e9039bfee94c3fab39a65748e0f82d (table test-table [id=508331bd23704a3fb62a5b54024e60a8]) successfully deleted
I20260808 07:07:01.259939 11283 log.cc:1196] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/15e9039bfee94c3fab39a65748e0f82d
I20260808 07:07:01.260277 11283 ts_tablet_manager.cc:1939] T 15e9039bfee94c3fab39a65748e0f82d P 44ab3022aaa54e2580292a9d604e629f: Deleting consensus metadata
I20260808 07:07:01.260768 10723 catalog_manager.cc:4841] TS 44ab3022aaa54e2580292a9d604e629f (127.9.94.2:36487): tablet 15e9039bfee94c3fab39a65748e0f82d (table test-table [id=508331bd23704a3fb62a5b54024e60a8]) successfully deleted
I20260808 07:07:01.262367 11284 ts_tablet_manager.cc:1918] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:01.262671 11284 log.cc:1196] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/wal/wals/15e9039bfee94c3fab39a65748e0f82d
I20260808 07:07:01.263151 11284 ts_tablet_manager.cc:1939] T 15e9039bfee94c3fab39a65748e0f82d P 147a6b3fabce4f20a1e64794b49b0a06: Deleting consensus metadata
I20260808 07:07:01.264201 10724 catalog_manager.cc:4841] TS 147a6b3fabce4f20a1e64794b49b0a06 (127.9.94.1:40487): tablet 15e9039bfee94c3fab39a65748e0f82d (table test-table [id=508331bd23704a3fb62a5b54024e60a8]) successfully deleted
W20260808 07:07:01.378206 11238 tablet.cc:2369] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:07:01.421206 11094 tablet.cc:2369] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:07:01.439572 10951 tablet.cc:2369] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:07:01.439589 11267 raft_consensus.cc:482] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:01.439693 11267 raft_consensus.cc:504] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.440157 11267 leader_election.cc:288] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 147a6b3fabce4f20a1e64794b49b0a06 (127.9.94.1:40487), 34ab04420400434f978bd23d52c5184e (127.9.94.3:42163)
I20260808 07:07:01.443585 11258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.440523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:54789 (local address 127.9.94.1:40487)
0808 07:07:01.440609 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.440612 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.440723 (+ 111us) server_negotiation.cc:407] Connection header received
0808 07:07:01.440886 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.440887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.440900 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.440959 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:01.441158 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.441670 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.442820 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.443179 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.443239 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.443249 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.443459 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.443505 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 07:07:01.443658 11259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.440753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:40773 (local address 127.9.94.3:42163)
0808 07:07:01.440836 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.440838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.440849 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:01.440910 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.440913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.440927 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.441012 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:01.441196 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.441705 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.442748 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.443294 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.443376 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.443387 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.443556 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.443598 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:07:01.443689 11291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.440674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:42163 (local address 127.9.94.2:40773)
0808 07:07:01.440765 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:01.440776 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:01.440848 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:01.441027 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:01.441027 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:01.441030 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:01.441096 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.441098 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.441825 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.441826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.442646 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.442648 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.443389 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.443390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.443475 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.443480 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:07:01.443537 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 07:07:01.443580 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76,"mutex_wait_us":16,"thread_start_us":39,"threads_started":1}
I20260808 07:07:01.443924 11184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07378a2babbf4c86b78c9abce0630536" candidate_uuid: "44ab3022aaa54e2580292a9d604e629f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34ab04420400434f978bd23d52c5184e" is_pre_election: true
I20260808 07:07:01.444021 11184 raft_consensus.cc:2454] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44ab3022aaa54e2580292a9d604e629f in term 0.
I20260808 07:07:01.444142 11290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.440459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:40487 (local address 127.9.94.2:54789)
0808 07:07:01.440614 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:01.440628 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:01.440746 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:01.440982 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:01.440983 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:01.440986 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:01.441075 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.441077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.441767 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.441769 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.442714 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.442717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.443282 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.443283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.443376 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.443382 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:07:01.443441 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 07:07:01.443493 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":32,"thread_start_us":79,"threads_started":1}
I20260808 07:07:01.444303 10977 leader_election.cc:302] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34ab04420400434f978bd23d52c5184e, 44ab3022aaa54e2580292a9d604e629f; no voters:
I20260808 07:07:01.444499 11267 raft_consensus.cc:2781] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:01.444553 11267 raft_consensus.cc:482] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:01.444592 11267 raft_consensus.cc:3037] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:01.444640 10903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07378a2babbf4c86b78c9abce0630536" candidate_uuid: "44ab3022aaa54e2580292a9d604e629f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "147a6b3fabce4f20a1e64794b49b0a06" is_pre_election: true
I20260808 07:07:01.444788 10903 raft_consensus.cc:2454] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44ab3022aaa54e2580292a9d604e629f in term 0.
I20260808 07:07:01.445477 11267 raft_consensus.cc:504] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.445634 11267 leader_election.cc:288] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [CANDIDATE]: Term 1 election: Requested vote from peers 147a6b3fabce4f20a1e64794b49b0a06 (127.9.94.1:40487), 34ab04420400434f978bd23d52c5184e (127.9.94.3:42163)
I20260808 07:07:01.445850 10903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07378a2babbf4c86b78c9abce0630536" candidate_uuid: "44ab3022aaa54e2580292a9d604e629f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "147a6b3fabce4f20a1e64794b49b0a06"
I20260808 07:07:01.445940 10903 raft_consensus.cc:3037] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:01.446107 11184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07378a2babbf4c86b78c9abce0630536" candidate_uuid: "44ab3022aaa54e2580292a9d604e629f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34ab04420400434f978bd23d52c5184e"
I20260808 07:07:01.446307 11184 raft_consensus.cc:3037] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:01.447067 10903 raft_consensus.cc:2454] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ab3022aaa54e2580292a9d604e629f in term 1.
I20260808 07:07:01.447211 11184 raft_consensus.cc:2454] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ab3022aaa54e2580292a9d604e629f in term 1.
I20260808 07:07:01.447244 10977 leader_election.cc:302] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 147a6b3fabce4f20a1e64794b49b0a06, 44ab3022aaa54e2580292a9d604e629f; no voters:
I20260808 07:07:01.447646 11267 raft_consensus.cc:2781] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:01.447981 11267 raft_consensus.cc:686] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [term 1 LEADER]: Becoming Leader. State: Replica: 44ab3022aaa54e2580292a9d604e629f, State: Running, Role: LEADER
I20260808 07:07:01.448266 11267 consensus_queue.cc:237] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.449512 10740 catalog_manager.cc:5495] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f reported cstate change: term changed from 0 to 1, leader changed from <none> to 44ab3022aaa54e2580292a9d604e629f (127.9.94.2). New cstate: current_term: 1 leader_uuid: "44ab3022aaa54e2580292a9d604e629f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } health_report { overall_health: UNKNOWN } } }
Aug 08 07:07:01 dist-test-slave-77v9 krb5kdc[10694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172820, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:01.524932 10791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.514384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35990 (local address 127.9.94.62:39005)
0808 07:07:01.514536 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.514539 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.514695 (+ 156us) server_negotiation.cc:407] Connection header received
0808 07:07:01.514834 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.514835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.514844 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.514923 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:01.515515 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.516066 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.516931 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.517134 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.517232 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.521009 (+ 3777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:01.521011 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:01.521011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:01.521019 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:01.523282 (+ 2263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:01.523781 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:01.523783 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:01.523783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:01.523880 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:01.524177 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:01.524178 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:01.524178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:01.524358 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:01.524441 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.524628 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.524761 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260808 07:07:01.525008 11299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.514134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39005 (local address 127.0.0.1:35990)
0808 07:07:01.514572 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:01.514587 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:01.514725 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:01.514929 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:01.514929 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:01.515348 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:01.515411 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.515413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.516164 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.516165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.516755 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.516757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.517243 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.517244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.517307 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.518556 (+ 1249us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:01.518564 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:01.520859 (+ 2295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:01.523413 (+ 2554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:01.523436 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:01.523439 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:01.523690 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:01.523960 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:01.523961 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:01.523962 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:01.524101 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:01.524446 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:01.524458 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:01.524516 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 07:07:01.524601 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 07:07:01.524853 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"mutex_wait_us":97,"thread_start_us":298,"threads_started":1}
I20260808 07:07:01.529178 10740 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:35990:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 07:07:01.529645 10740 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:01.533517 10882 tablet_service.cc:1467] Processing CreateTablet for tablet 59e399aa4dfc4902b9961b757f35051b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9a4ca59425974bdfbb3e20e0dd406365]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:07:01.533880 11167 tablet_service.cc:1467] Processing CreateTablet for tablet 59e399aa4dfc4902b9961b757f35051b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9a4ca59425974bdfbb3e20e0dd406365]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:07:01.533957 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59e399aa4dfc4902b9961b757f35051b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:01.533881 11025 tablet_service.cc:1467] Processing CreateTablet for tablet 59e399aa4dfc4902b9961b757f35051b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9a4ca59425974bdfbb3e20e0dd406365]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:07:01.534053 11167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59e399aa4dfc4902b9961b757f35051b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:01.534129 11025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59e399aa4dfc4902b9961b757f35051b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:01.537289 11261 tablet_bootstrap.cc:492] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06: Bootstrap starting.
I20260808 07:07:01.538237 11261 tablet_bootstrap.cc:654] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:01.538828 11260 tablet_bootstrap.cc:492] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f: Bootstrap starting.
I20260808 07:07:01.539309 11260 tablet_bootstrap.cc:654] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:01.539911 11261 tablet_bootstrap.cc:492] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06: No bootstrap required, opened a new log
I20260808 07:07:01.539876 11264 tablet_bootstrap.cc:492] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e: Bootstrap starting.
I20260808 07:07:01.539988 11261 ts_tablet_manager.cc:1397] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:07:01.540159 11261 raft_consensus.cc:348] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.540258 11261 raft_consensus.cc:374] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:01.540298 11261 raft_consensus.cc:729] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 147a6b3fabce4f20a1e64794b49b0a06, State: Initialized, Role: FOLLOWER
I20260808 07:07:01.540350 11261 consensus_queue.cc:260] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.540472 11261 ts_tablet_manager.cc:1428] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:07:01.540627 11264 tablet_bootstrap.cc:654] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:01.540611 11266 tablet_replica.cc:439] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } }
I20260808 07:07:01.540704 11266 tablet_replica.cc:442] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:01.541157 11260 tablet_bootstrap.cc:492] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f: No bootstrap required, opened a new log
I20260808 07:07:01.541220 11260 ts_tablet_manager.cc:1397] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:07:01.541396 11260 raft_consensus.cc:348] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.541508 11260 raft_consensus.cc:374] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:01.541540 11260 raft_consensus.cc:729] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44ab3022aaa54e2580292a9d604e629f, State: Initialized, Role: FOLLOWER
I20260808 07:07:01.541590 11260 consensus_queue.cc:260] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.541689 11260 ts_tablet_manager.cc:1428] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 07:07:01.541858 11267 tablet_replica.cc:439] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } }
I20260808 07:07:01.541942 11267 tablet_replica.cc:442] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:01.541953 11264 tablet_bootstrap.cc:492] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e: No bootstrap required, opened a new log
I20260808 07:07:01.542016 11264 ts_tablet_manager.cc:1397] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:07:01.542277 11264 raft_consensus.cc:348] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.542424 11264 raft_consensus.cc:374] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:01.542451 11264 raft_consensus.cc:729] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34ab04420400434f978bd23d52c5184e, State: Initialized, Role: FOLLOWER
I20260808 07:07:01.542695 11264 consensus_queue.cc:260] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.542901 11264 ts_tablet_manager.cc:1428] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 07:07:01.542980 11268 tablet_replica.cc:439] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } }
I20260808 07:07:01.543242 11268 tablet_replica.cc:442] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:01.762128 11268 raft_consensus.cc:482] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:01.762301 11268 raft_consensus.cc:504] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.762768 11268 leader_election.cc:288] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 147a6b3fabce4f20a1e64794b49b0a06 (127.9.94.1:40487), 44ab3022aaa54e2580292a9d604e629f (127.9.94.2:36487)
I20260808 07:07:01.767446 11304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.763046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:36487 (local address 127.9.94.3:47121)
0808 07:07:01.763207 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:01.763221 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:01.763303 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:01.763585 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:01.763586 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:01.763591 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:01.763697 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.763698 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.764914 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.764916 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.766361 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.766365 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.767131 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.767132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.767212 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.767217 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:07:01.767297 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 07:07:01.767351 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":131,"thread_start_us":62,"threads_started":1}
I20260808 07:07:01.767438 11306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.763206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:47121 (local address 127.9.94.2:36487)
0808 07:07:01.763345 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.763347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.763356 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:01.763391 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.763392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.763404 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.763499 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:01.763924 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.764785 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.766525 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.767042 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.767130 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.767145 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.767306 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.767351 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":73,"threads_started":1}
I20260808 07:07:01.767930 11305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.763046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:40487 (local address 127.9.94.3:56497)
0808 07:07:01.763207 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:01.763221 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:01.763300 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:01.763585 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:01.763586 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:01.763589 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:01.763689 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.763692 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.764979 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.764979 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.766371 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.766372 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.767529 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.767530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.767611 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.767618 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 07:07:01.767765 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 07:07:01.767834 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":55,"thread_start_us":79,"threads_started":1}
I20260808 07:07:01.767931 11258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.763209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:56497 (local address 127.9.94.1:40487)
0808 07:07:01.763266 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.763269 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.763284 (+ 15us) server_negotiation.cc:407] Connection header received
0808 07:07:01.763391 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.763392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.763407 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.763500 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:01.763916 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.764803 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.766618 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.767299 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.767424 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.767439 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.767790 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.767870 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:07:01.767885 11046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59e399aa4dfc4902b9961b757f35051b" candidate_uuid: "34ab04420400434f978bd23d52c5184e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ab3022aaa54e2580292a9d604e629f" is_pre_election: true
I20260808 07:07:01.768030 11046 raft_consensus.cc:2454] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34ab04420400434f978bd23d52c5184e in term 0.
I20260808 07:07:01.768249 10903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59e399aa4dfc4902b9961b757f35051b" candidate_uuid: "34ab04420400434f978bd23d52c5184e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "147a6b3fabce4f20a1e64794b49b0a06" is_pre_election: true
I20260808 07:07:01.768361 10903 raft_consensus.cc:2454] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34ab04420400434f978bd23d52c5184e in term 0.
I20260808 07:07:01.768337 11118 leader_election.cc:302] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34ab04420400434f978bd23d52c5184e, 44ab3022aaa54e2580292a9d604e629f; no voters:
I20260808 07:07:01.768525 11268 raft_consensus.cc:2781] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:01.768577 11268 raft_consensus.cc:482] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:01.768610 11268 raft_consensus.cc:3037] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:01.769474 11268 raft_consensus.cc:504] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.769656 11268 leader_election.cc:288] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [CANDIDATE]: Term 1 election: Requested vote from peers 147a6b3fabce4f20a1e64794b49b0a06 (127.9.94.1:40487), 44ab3022aaa54e2580292a9d604e629f (127.9.94.2:36487)
I20260808 07:07:01.769850 10903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59e399aa4dfc4902b9961b757f35051b" candidate_uuid: "34ab04420400434f978bd23d52c5184e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "147a6b3fabce4f20a1e64794b49b0a06"
I20260808 07:07:01.769868 11046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59e399aa4dfc4902b9961b757f35051b" candidate_uuid: "34ab04420400434f978bd23d52c5184e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ab3022aaa54e2580292a9d604e629f"
I20260808 07:07:01.769958 11046 raft_consensus.cc:3037] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:01.769958 10903 raft_consensus.cc:3037] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:01.770856 11046 raft_consensus.cc:2454] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34ab04420400434f978bd23d52c5184e in term 1.
I20260808 07:07:01.770856 10903 raft_consensus.cc:2454] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34ab04420400434f978bd23d52c5184e in term 1.
I20260808 07:07:01.771114 11119 leader_election.cc:302] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 147a6b3fabce4f20a1e64794b49b0a06, 34ab04420400434f978bd23d52c5184e; no voters:
I20260808 07:07:01.771274 11268 raft_consensus.cc:2781] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:01.771557 11268 raft_consensus.cc:686] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [term 1 LEADER]: Becoming Leader. State: Replica: 34ab04420400434f978bd23d52c5184e, State: Running, Role: LEADER
I20260808 07:07:01.771684 11268 consensus_queue.cc:237] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } }
I20260808 07:07:01.772053 11307 tablet_replica.cc:439] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e: TxnStatusTablet state changed. Reason: New leader 34ab04420400434f978bd23d52c5184e. Latest consensus state: current_term: 1 leader_uuid: "34ab04420400434f978bd23d52c5184e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } }
I20260808 07:07:01.772151 11307 tablet_replica.cc:442] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:07:01.772452 11309 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 07:07:01.772564 11309 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 07:07:01.772643 10736 catalog_manager.cc:5495] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e reported cstate change: term changed from 0 to 1, leader changed from <none> to 34ab04420400434f978bd23d52c5184e (127.9.94.3). New cstate: current_term: 1 leader_uuid: "34ab04420400434f978bd23d52c5184e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } health_report { overall_health: HEALTHY } } }
I20260808 07:07:01.838778 11299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.833278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:42163 (local address 127.0.0.1:40922)
0808 07:07:01.833389 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:01.833403 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:01.833468 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:01.834154 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:01.834155 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:01.834156 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:07:01.834224 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.834228 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.835966 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.835967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.837181 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.837185 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.837896 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.837897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.838017 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.838043 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:07:01.838545 (+ 502us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:07:01.838557 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 07:07:01.838615 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:07:01.838680 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 07:07:01.838755 11259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.833387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40922 (local address 127.9.94.3:42163)
0808 07:07:01.833439 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.833442 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.833454 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:07:01.833751 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.833752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.833773 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.834115 (+ 342us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:01.834354 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.835666 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.837333 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.837615 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.837876 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.838329 (+ 453us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:01.838452 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:01.838546 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.838634 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.838657 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:07:01.840870 11046 raft_consensus.cc:1261] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f [term 1 FOLLOWER]: Refusing update from remote peer 34ab04420400434f978bd23d52c5184e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:01.841207 10903 raft_consensus.cc:1261] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06 [term 1 FOLLOWER]: Refusing update from remote peer 34ab04420400434f978bd23d52c5184e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:01.841233 11307 consensus_queue.cc:1035] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:01.841573 11307 consensus_queue.cc:1035] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e [LEADER]: Connected to new peer: Peer: permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:01.841951 11267 tablet_replica.cc:439] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f: TxnStatusTablet state changed. Reason: New leader 34ab04420400434f978bd23d52c5184e. Latest consensus state: current_term: 1 leader_uuid: "34ab04420400434f978bd23d52c5184e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } }
I20260808 07:07:01.842056 11267 tablet_replica.cc:442] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:01.842396 11266 tablet_replica.cc:439] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06: TxnStatusTablet state changed. Reason: New leader 34ab04420400434f978bd23d52c5184e. Latest consensus state: current_term: 1 leader_uuid: "34ab04420400434f978bd23d52c5184e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } }
I20260808 07:07:01.842509 11266 tablet_replica.cc:442] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:01.843356 11268 tablet_replica.cc:439] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "34ab04420400434f978bd23d52c5184e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } }
I20260808 07:07:01.843485 11268 tablet_replica.cc:442] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:07:01.843551 11268 tablet_replica.cc:439] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "34ab04420400434f978bd23d52c5184e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } }
I20260808 07:07:01.843623 11268 tablet_replica.cc:442] T 59e399aa4dfc4902b9961b757f35051b P 34ab04420400434f978bd23d52c5184e: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:07:01.843693 11313 mvcc.cc:205] Tried to move back new op lower bound from 7316163878257291264 to 7316163877977554944. Current Snapshot: MvccSnapshot[applied={T|T < 7316163878257291264}]
I20260808 07:07:01.843806 11267 tablet_replica.cc:439] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "34ab04420400434f978bd23d52c5184e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } }
I20260808 07:07:01.843889 11267 tablet_replica.cc:442] T 59e399aa4dfc4902b9961b757f35051b P 44ab3022aaa54e2580292a9d604e629f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:01.846203 11266 tablet_replica.cc:439] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "34ab04420400434f978bd23d52c5184e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 } } peers { permanent_uuid: "44ab3022aaa54e2580292a9d604e629f" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36487 } } peers { permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 } } }
I20260808 07:07:01.846585 11266 tablet_replica.cc:442] T 59e399aa4dfc4902b9961b757f35051b P 147a6b3fabce4f20a1e64794b49b0a06: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:01.855216 11306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.848349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54188 (local address 127.9.94.2:36487)
0808 07:07:01.848430 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.848433 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.850274 (+ 1841us) server_negotiation.cc:407] Connection header received
0808 07:07:01.850647 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.850649 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.850681 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.850775 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:01.851013 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.852312 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.854019 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.854241 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.854318 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.854572 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:01.854694 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:01.854775 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.855035 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.855073 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 07:07:01.869274 11325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.860192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:42163 (local address 127.9.94.2:33869)
0808 07:07:01.860533 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:01.860550 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:01.860638 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:01.861330 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:01.861331 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:01.861333 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:07:01.861421 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.861423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.863097 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.863098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.867961 (+ 4863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.867970 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.868489 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.868491 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.868552 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.868577 (+ 25us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:07:01.869011 (+ 434us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:07:01.869014 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:01.869089 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 07:07:01.869153 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":146,"threads_started":1}
I20260808 07:07:01.869246 11259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.860338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:33869 (local address 127.9.94.3:42163)
0808 07:07:01.860426 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.860429 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.860941 (+ 512us) server_negotiation.cc:407] Connection header received
0808 07:07:01.860983 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.860985 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.861001 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.861101 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:01.861554 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.862602 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.868121 (+ 5519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.868351 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.868449 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.868775 (+ 326us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:01.868893 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:01.868992 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.869108 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.869137 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 07:07:01.881469 11184 raft_consensus.cc:1261] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e [term 1 FOLLOWER]: Refusing update from remote peer 44ab3022aaa54e2580292a9d604e629f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:01.881557 10903 raft_consensus.cc:1261] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06 [term 1 FOLLOWER]: Refusing update from remote peer 44ab3022aaa54e2580292a9d604e629f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:01.881845 11267 consensus_queue.cc:1035] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [LEADER]: Connected to new peer: Peer: permanent_uuid: "34ab04420400434f978bd23d52c5184e" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:01.882068 11292 consensus_queue.cc:1035] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [LEADER]: Connected to new peer: Peer: permanent_uuid: "147a6b3fabce4f20a1e64794b49b0a06" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:01.898672 11330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.893256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:36487 (local address 127.9.94.3:56609)
0808 07:07:01.893504 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:01.893517 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:01.893599 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:01.893928 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:01.893929 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:01.893931 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:07:01.894527 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.894531 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.895752 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.895753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.896899 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:01.896902 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.898001 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.898002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:01.898068 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.898113 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:07:01.898375 (+ 262us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:07:01.898378 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:01.898439 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 07:07:01.898508 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":137,"threads_started":1}
I20260808 07:07:01.898722 11306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.893307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:56609 (local address 127.9.94.2:36487)
0808 07:07:01.893368 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.893371 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.893575 (+ 204us) server_negotiation.cc:407] Connection header received
0808 07:07:01.893669 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.893670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.893812 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.893873 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:01.894644 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.895571 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.897004 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.897768 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.897866 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.898218 (+ 352us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:01.898258 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:01.898343 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.898604 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.898635 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:07:01.914005 10736 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:01.914167 10736 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:01.915081 10736 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ddd4b0bc31ee4862a784326f2996755b: Sending DeleteTablet for 3 replicas of tablet 07378a2babbf4c86b78c9abce0630536
I20260808 07:07:01.915505 11025 tablet_service.cc:1514] Processing DeleteTablet for tablet 07378a2babbf4c86b78c9abce0630536 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:01 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:54180
I20260808 07:07:01.915843 11167 tablet_service.cc:1514] Processing DeleteTablet for tablet 07378a2babbf4c86b78c9abce0630536 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:01 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:40916
I20260808 07:07:01.916122 10882 tablet_service.cc:1514] Processing DeleteTablet for tablet 07378a2babbf4c86b78c9abce0630536 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:01 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:50412
I20260808 07:07:01.916356 11335 tablet_replica.cc:330] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e: stopping tablet replica
I20260808 07:07:01.916445 11335 raft_consensus.cc:2229] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:01.916495 11335 raft_consensus.cc:2258] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:01.916605 11336 tablet_replica.cc:330] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06: stopping tablet replica
I20260808 07:07:01.916668 11336 raft_consensus.cc:2229] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:01.916713 11336 raft_consensus.cc:2258] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:01.917074 11333 tablet_replica.cc:330] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f: stopping tablet replica
I20260808 07:07:01.917157 11333 raft_consensus.cc:2229] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:07:01.917279 11333 raft_consensus.cc:2258] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:01.917572 11336 ts_tablet_manager.cc:1905] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:01.917652 11335 ts_tablet_manager.cc:1905] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:01.919929 11333 ts_tablet_manager.cc:1905] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:01.920357 11336 ts_tablet_manager.cc:1918] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:07:01.920492 11336 log.cc:1196] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-0/wal/wals/07378a2babbf4c86b78c9abce0630536
I20260808 07:07:01.921044 11336 ts_tablet_manager.cc:1939] T 07378a2babbf4c86b78c9abce0630536 P 147a6b3fabce4f20a1e64794b49b0a06: Deleting consensus metadata
I20260808 07:07:01.923059 10724 catalog_manager.cc:4841] TS 147a6b3fabce4f20a1e64794b49b0a06 (127.9.94.1:40487): tablet 07378a2babbf4c86b78c9abce0630536 (table test-table [id=fa9e5ecaf7894aa192cb56c77d85ef16]) successfully deleted
I20260808 07:07:01.924230 11333 ts_tablet_manager.cc:1918] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:07:01.924314 11333 log.cc:1196] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/07378a2babbf4c86b78c9abce0630536
I20260808 07:07:01.925238 11333 ts_tablet_manager.cc:1939] T 07378a2babbf4c86b78c9abce0630536 P 44ab3022aaa54e2580292a9d604e629f: Deleting consensus metadata
I20260808 07:07:01.925778 10723 catalog_manager.cc:4841] TS 44ab3022aaa54e2580292a9d604e629f (127.9.94.2:36487): tablet 07378a2babbf4c86b78c9abce0630536 (table test-table [id=fa9e5ecaf7894aa192cb56c77d85ef16]) successfully deleted
Aug 08 07:07:01 dist-test-slave-77v9 krb5kdc[10694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172821, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.94.1@KRBTEST.COM
I20260808 07:07:01.941112 11335 ts_tablet_manager.cc:1918] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:07:01.941226 11335 log.cc:1196] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/07378a2babbf4c86b78c9abce0630536
I20260808 07:07:01.941548 11335 ts_tablet_manager.cc:1939] T 07378a2babbf4c86b78c9abce0630536 P 34ab04420400434f978bd23d52c5184e: Deleting consensus metadata
I20260808 07:07:01.942196 11258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.916683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50436 (local address 127.9.94.1:40487)
0808 07:07:01.916735 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.916737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.921511 (+ 4774us) server_negotiation.cc:407] Connection header received
0808 07:07:01.921643 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.921644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.921658 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.921694 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:01.922646 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.923844 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.925505 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.925832 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.925895 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.933921 (+ 8026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:01.933939 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:01.933939 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:01.933952 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:01.937428 (+ 3476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:01.939385 (+ 1957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:01.939391 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:01.939392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:01.939498 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:01.940326 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:01.940328 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:01.940328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:01.940656 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:01.941782 (+ 1126us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.941838 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.942068 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260808 07:07:01.942937 10944 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50436
I20260808 07:07:01.942997 10724 catalog_manager.cc:4841] TS 34ab04420400434f978bd23d52c5184e (127.9.94.3:42163): tablet 07378a2babbf4c86b78c9abce0630536 (table test-table [id=fa9e5ecaf7894aa192cb56c77d85ef16]) successfully deleted
I20260808 07:07:01.955701 10791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:01.944334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35998 (local address 127.9.94.62:39005)
0808 07:07:01.944385 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:01.944388 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:01.944765 (+ 377us) server_negotiation.cc:407] Connection header received
0808 07:07:01.944872 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:01.944874 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:01.944888 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:01.944961 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:01.945724 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.946616 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.947810 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:01.948151 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:01.948242 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:01.951091 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:01.951093 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:01.951093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:01.951103 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:01.953597 (+ 2494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:01.954269 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:01.954270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:01.954271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:01.954351 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:01.954727 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:01.954728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:01.954729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:01.954923 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:01.955083 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:01.955374 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 07:07:01.955546 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260808 07:07:01.956491 10736 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35998
I20260808 07:07:01.958515 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 10814
I20260808 07:07:01.972165 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 10960
I20260808 07:07:01.982012 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 11102
I20260808 07:07:01.994199 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 10707
2026-08-08T07:07:01Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3159 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:07:02 dist-test-slave-77v9 krb5kdc[11342](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:07:02 dist-test-slave-77v9 krb5kdc[11342](info): set up 2 sockets
Aug 08 07:07:02 dist-test-slave-77v9 krb5kdc[11342](info): commencing operation
krb5kdc: starting...
W20260808 07:07:03.272680 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:07:03 dist-test-slave-77v9 krb5kdc[11342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172823, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:07:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:07:03.424077 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:43931
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:37069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:43931
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:03.529451 11355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:03.529742 11355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:03.529783 11355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:03.531347 11355 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:03.531453 11355 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 07:07:03.531483 11355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:03.531518 11355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:03.531554 11355 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:03.531582 11355 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:03.533483 11355 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:37069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:43931
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:43931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:03.533977 11355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:03.534278 11355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:03.540439 11360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:03.540462 11363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:03.540503 11361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:03.540496 11355 server_base.cc:1034] running on GCE node
I20260808 07:07:03.540985 11355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:03.541391 11355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:03.542584 11355 hybrid_clock.cc:648] HybridClock initialized: now 1786172823542549 us; error 56 us; skew 500 ppm
Aug 08 07:07:03 dist-test-slave-77v9 krb5kdc[11342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172823, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:03.545572 11355 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:07:03.546145 11355 webserver.cc:460] Webserver started at http://127.9.94.62:38723/ using document root <none> and password file <none>
I20260808 07:07:03.546401 11355 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:03.546495 11355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:03.546665 11355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:03.547869 11355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "e7d970e3859345dca90a885c8808f827"
format_stamp: "Formatted at 2026-08-08 07:07:03 on dist-test-slave-77v9"
server_key: "2e2df22b1568c97a998646864b1cc4e5"
server_key_iv: "51f6b82e7e2af5b5e2f8a6c4cb6ff8e9"
server_key_version: "encryptionkey@0"
I20260808 07:07:03.548293 11355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "e7d970e3859345dca90a885c8808f827"
format_stamp: "Formatted at 2026-08-08 07:07:03 on dist-test-slave-77v9"
server_key: "2e2df22b1568c97a998646864b1cc4e5"
server_key_iv: "51f6b82e7e2af5b5e2f8a6c4cb6ff8e9"
server_key_version: "encryptionkey@0"
I20260808 07:07:03.550074 11355 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260808 07:07:03.551250 11370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:03.551527 11355 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:03.551653 11355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "e7d970e3859345dca90a885c8808f827"
format_stamp: "Formatted at 2026-08-08 07:07:03 on dist-test-slave-77v9"
server_key: "2e2df22b1568c97a998646864b1cc4e5"
server_key_iv: "51f6b82e7e2af5b5e2f8a6c4cb6ff8e9"
server_key_version: "encryptionkey@0"
I20260808 07:07:03.551743 11355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:03.565497 11355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:03.568521 11355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:03.568734 11355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:03.574174 11355 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:43931
I20260808 07:07:03.574255 11434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:43931 every 8 connection(s)
I20260808 07:07:03.574677 11355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:03.575441 11435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:03.578866 11435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827: Bootstrap starting.
I20260808 07:07:03.579527 11435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:03.579785 11435 log.cc:824] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:03.580539 11435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827: No bootstrap required, opened a new log
I20260808 07:07:03.581600 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 11355
I20260808 07:07:03.581705 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:03.581897 9592 external_mini_cluster.cc:1428] Setting key 0407d8013f42e350b3ac6cac6136eecf
I20260808 07:07:03.582839 11435 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d970e3859345dca90a885c8808f827" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43931 } }
I20260808 07:07:03.583067 11435 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:03.583106 11435 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7d970e3859345dca90a885c8808f827, State: Initialized, Role: FOLLOWER
I20260808 07:07:03.583232 11435 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d970e3859345dca90a885c8808f827" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43931 } }
I20260808 07:07:03.583313 11435 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:03.583362 11435 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:03.583416 11435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:03.584302 11435 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d970e3859345dca90a885c8808f827" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43931 } }
I20260808 07:07:03.584424 11435 leader_election.cc:302] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7d970e3859345dca90a885c8808f827; no voters:
I20260808 07:07:03.584614 11435 leader_election.cc:288] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:03.584684 11440 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:03.584889 11440 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [term 1 LEADER]: Becoming Leader. State: Replica: e7d970e3859345dca90a885c8808f827, State: Running, Role: LEADER
I20260808 07:07:03.584965 11435 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:03.585008 11440 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d970e3859345dca90a885c8808f827" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43931 } }
I20260808 07:07:03.585373 11441 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7d970e3859345dca90a885c8808f827" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d970e3859345dca90a885c8808f827" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43931 } } }
I20260808 07:07:03.585480 11441 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:03.585740 11442 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7d970e3859345dca90a885c8808f827. Latest consensus state: current_term: 1 leader_uuid: "e7d970e3859345dca90a885c8808f827" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d970e3859345dca90a885c8808f827" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43931 } } }
I20260808 07:07:03.585855 11442 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:03.586081 11449 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:03.586647 11449 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:03.588393 11449 catalog_manager.cc:1347] Generated new cluster ID: d76f4b86ca9f4764be43da4c6c00be99
I20260808 07:07:03.588454 11449 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:07:03 dist-test-slave-77v9 krb5kdc[11342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172823, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:03.595196 11439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:03.582785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36712 (local address 127.9.94.62:43931)
0808 07:07:03.582994 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:03.583005 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:03.583041 (+ 36us) server_negotiation.cc:407] Connection header received
0808 07:07:03.583179 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:03.583187 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:03.583249 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:03.583442 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:03.584373 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.586017 (+ 1644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.587110 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.587795 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.587932 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:03.590976 (+ 3044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:03.590981 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:03.590982 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:03.590996 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:03.593308 (+ 2312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:03.593767 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:03.593771 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:03.593771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:03.593904 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:03.594137 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:03.594138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:03.594138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:03.594479 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:03.594634 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:03.594764 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 07:07:03.594910 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":107,"threads_started":1}
I20260808 07:07:03.609939 11449 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:03.610777 11449 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:03.615226 11449 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827: Generated new TSK 0
I20260808 07:07:03.615505 11449 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:07:03.653471 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:43931
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:37069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:03.753870 11462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:03.754225 11462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:03.754266 11462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:03.756700 11462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:03.756800 11462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:03.756863 11462 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 07:07:03.756880 11462 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:07:03.756908 11462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:03.759346 11462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:37069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.94.62:43931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:03.759621 11462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:03.759836 11462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:03.765547 11468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:03.765548 11470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:03.765539 11467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:03.765861 11462 server_base.cc:1034] running on GCE node
I20260808 07:07:03.766084 11462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:03.766341 11462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:03.767560 11462 hybrid_clock.cc:648] HybridClock initialized: now 1786172823767537 us; error 40 us; skew 500 ppm
Aug 08 07:07:03 dist-test-slave-77v9 krb5kdc[11342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172823, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:03.770651 11462 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:07:03.771175 11462 webserver.cc:460] Webserver started at http://127.9.94.1:45301/ using document root <none> and password file <none>
I20260808 07:07:03.771554 11462 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:03.771621 11462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:03.771790 11462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:03.773080 11462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "5580656ad96740bca8c6a45b31c3d903"
format_stamp: "Formatted at 2026-08-08 07:07:03 on dist-test-slave-77v9"
server_key: "e22aacfddceea3cd5fd1ead159bf3bb2"
server_key_iv: "01efc5c04d9576582fce61c33d337cd0"
server_key_version: "encryptionkey@0"
I20260808 07:07:03.773468 11462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "5580656ad96740bca8c6a45b31c3d903"
format_stamp: "Formatted at 2026-08-08 07:07:03 on dist-test-slave-77v9"
server_key: "e22aacfddceea3cd5fd1ead159bf3bb2"
server_key_iv: "01efc5c04d9576582fce61c33d337cd0"
server_key_version: "encryptionkey@0"
I20260808 07:07:03.775023 11462 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:07:03.776216 11477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:03.776598 11462 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:03.776908 11462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "5580656ad96740bca8c6a45b31c3d903"
format_stamp: "Formatted at 2026-08-08 07:07:03 on dist-test-slave-77v9"
server_key: "e22aacfddceea3cd5fd1ead159bf3bb2"
server_key_iv: "01efc5c04d9576582fce61c33d337cd0"
server_key_version: "encryptionkey@0"
I20260808 07:07:03.777068 11462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:03.792763 11462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:03.796173 11462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:03.796312 11462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:03.797010 11462 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:03.797057 11462 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:03.797084 11462 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:03.797097 11462 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:03.805018 11462 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:43615
I20260808 07:07:03.805115 11594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:43615 every 8 connection(s)
I20260808 07:07:03.805459 11462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:07:03 dist-test-slave-77v9 krb5kdc[11342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172823, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:03.810652 11439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:03.797648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:52303 (local address 127.9.94.62:43931)
0808 07:07:03.797723 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:03.797726 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:03.798015 (+ 289us) server_negotiation.cc:407] Connection header received
0808 07:07:03.798872 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:03.798873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:03.798893 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:03.798973 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:03.800083 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.801128 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.802959 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.803493 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.803603 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:03.806890 (+ 3287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:03.806892 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:03.806892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:03.806901 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:03.808761 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:03.809340 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:03.809342 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:03.809342 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:03.809404 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:03.809916 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:03.809917 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:03.809918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:03.810064 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:03.810142 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:03.810470 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 07:07:03.810565 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 07:07:03.810736 11486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:03.797591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:43931 (local address 127.9.94.1:52303)
0808 07:07:03.797791 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:03.797863 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:03.798716 (+ 853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:03.799133 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:03.799138 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:03.799596 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:03.799949 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:03.799957 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.801246 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.801247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:03.802833 (+ 1586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:03.802837 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.803623 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.803625 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:03.803799 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:03.804544 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:03.804554 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:03.806696 (+ 2142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:03.808971 (+ 2275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:03.808986 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:03.808988 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:03.809254 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:03.809499 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:03.809500 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:03.809501 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:03.809652 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:03.810145 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:03.810152 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:03.810300 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 07:07:03.810404 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 07:07:03.810552 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":99,"threads_started":1}
I20260808 07:07:03.811692 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 11462
I20260808 07:07:03.811842 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:03.812171 9592 external_mini_cluster.cc:1428] Setting key c80086d7f6c489e775fbc0fb73951198
I20260808 07:07:03.812155 11596 heartbeater.cc:347] Connected to a master server at 127.9.94.62:43931
I20260808 07:07:03.812268 11596 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:03.812541 11596 heartbeater.cc:511] Master 127.9.94.62:43931 requested a full tablet report, sending...
I20260808 07:07:03.813239 11388 ts_manager.cc:194] Registered new tserver with Master: 5580656ad96740bca8c6a45b31c3d903 (127.9.94.1:43615)
I20260808 07:07:03.814229 11388 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:52303
I20260808 07:07:03.821084 11603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:03.813460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:43931 (local address 127.9.94.1:54273)
0808 07:07:03.813638 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:03.813654 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:03.813729 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:03.813868 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:03.813869 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:03.814080 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:03.814136 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:03.814138 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.815025 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.815027 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:03.816053 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:03.816056 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.816478 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.816480 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:03.816576 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:03.817167 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:03.817172 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:03.817555 (+ 383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:03.819660 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:03.819661 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:03.819662 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:03.819937 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:03.820205 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:03.820206 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:03.820206 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:03.820280 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:03.820650 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:03.820650 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:03.820698 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 07:07:03.820764 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 07:07:03.820996 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":96,"threads_started":1}
I20260808 07:07:03.821079 11439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:03.813513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:54273 (local address 127.9.94.62:43931)
0808 07:07:03.813565 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:03.813567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:03.813713 (+ 146us) server_negotiation.cc:407] Connection header received
0808 07:07:03.813795 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:03.813796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:03.813808 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:03.813864 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:03.814228 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.814921 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.816173 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.816387 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.816457 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:03.817683 (+ 1226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:03.817685 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:03.817685 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:03.817694 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:03.819543 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:03.820023 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:03.820024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:03.820024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:03.820099 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:03.820365 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:03.820366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:03.820366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:03.820547 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:03.820639 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:03.820837 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 07:07:03.820945 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:07:03.850569 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:43931
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:37069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:03.944025 11606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:03.944283 11606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:03.944331 11606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:03.945669 11606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:03.945745 11606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:03.945786 11606 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 07:07:03.945829 11606 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:07:03.945869 11606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:03.947582 11606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:37069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.94.62:43931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:03.947875 11606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:03.948172 11606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:03.954710 11614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:03.954761 11611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:03.954782 11612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:03.955190 11606 server_base.cc:1034] running on GCE node
I20260808 07:07:03.955505 11606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:03.955902 11606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:03.957176 11606 hybrid_clock.cc:648] HybridClock initialized: now 1786172823957123 us; error 74 us; skew 500 ppm
Aug 08 07:07:03 dist-test-slave-77v9 krb5kdc[11342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172823, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:03.961133 11606 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:07:03.961848 11606 webserver.cc:460] Webserver started at http://127.9.94.2:44153/ using document root <none> and password file <none>
I20260808 07:07:03.962159 11606 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:03.962219 11606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:03.962373 11606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:03.963658 11606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "4c0f715f33bf486b80f47137c8c8ae30"
format_stamp: "Formatted at 2026-08-08 07:07:03 on dist-test-slave-77v9"
server_key: "e3fa1d26820e5f6d62f634950cd2d637"
server_key_iv: "5d07305e5af5f97c68df31aef89c2040"
server_key_version: "encryptionkey@0"
I20260808 07:07:03.964062 11606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "4c0f715f33bf486b80f47137c8c8ae30"
format_stamp: "Formatted at 2026-08-08 07:07:03 on dist-test-slave-77v9"
server_key: "e3fa1d26820e5f6d62f634950cd2d637"
server_key_iv: "5d07305e5af5f97c68df31aef89c2040"
server_key_version: "encryptionkey@0"
I20260808 07:07:03.966024 11606 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 07:07:03.967605 11621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:03.968037 11606 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:07:03.968164 11606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "4c0f715f33bf486b80f47137c8c8ae30"
format_stamp: "Formatted at 2026-08-08 07:07:03 on dist-test-slave-77v9"
server_key: "e3fa1d26820e5f6d62f634950cd2d637"
server_key_iv: "5d07305e5af5f97c68df31aef89c2040"
server_key_version: "encryptionkey@0"
I20260808 07:07:03.968266 11606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:03.977425 11606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:03.980072 11606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:03.980253 11606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:03.980966 11606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:03.981011 11606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:03.981037 11606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:03.981051 11606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:07:03 dist-test-slave-77v9 krb5kdc[11342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172823, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:03.990068 11606 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:38515
I20260808 07:07:03.990154 11737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:38515 every 8 connection(s)
I20260808 07:07:03.990571 11606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:07:03.993813 11439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:03.981667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:41129 (local address 127.9.94.62:43931)
0808 07:07:03.981741 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:03.981744 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:03.981950 (+ 206us) server_negotiation.cc:407] Connection header received
0808 07:07:03.982518 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:03.982519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:03.982533 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:03.982607 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:03.983376 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.984354 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.986250 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.986662 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.986779 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:03.990316 (+ 3537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:03.990319 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:03.990319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:03.990331 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:03.992191 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:03.992674 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:03.992676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:03.992676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:03.992749 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:03.993058 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:03.993059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:03.993060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:03.993200 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:03.993279 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:03.993601 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 07:07:03.993707 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 07:07:03.994040 11630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:03.981611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:43931 (local address 127.9.94.2:41129)
0808 07:07:03.981803 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:03.981847 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:03.982401 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:03.982688 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:03.982691 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:03.983048 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:03.983272 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:03.983277 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.984483 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.984484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:03.986135 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:03.986139 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.986801 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.986802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:03.986969 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:03.987971 (+ 1002us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:03.987980 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:03.990157 (+ 2177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:03.992318 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:03.992326 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:03.992329 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:03.992585 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:03.992846 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:03.992847 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:03.992847 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:03.992972 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:03.993281 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:03.993289 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:03.993448 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 07:07:03.993556 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 07:07:03.993761 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":100,"threads_started":1}
I20260808 07:07:03.994598 11738 heartbeater.cc:347] Connected to a master server at 127.9.94.62:43931
I20260808 07:07:03.994788 11738 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:03.995021 11738 heartbeater.cc:511] Master 127.9.94.62:43931 requested a full tablet report, sending...
I20260808 07:07:03.995498 11387 ts_manager.cc:194] Registered new tserver with Master: 4c0f715f33bf486b80f47137c8c8ae30 (127.9.94.2:38515)
I20260808 07:07:03.996091 11387 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:41129
I20260808 07:07:03.998186 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 11606
I20260808 07:07:03.998304 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:07:03.998520 9592 external_mini_cluster.cc:1428] Setting key c9d0370ca824754748dc1ebf26f8fc1d
I20260808 07:07:04.003863 11744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:03.995845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:43931 (local address 127.9.94.2:34355)
0808 07:07:03.996110 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:03.996124 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:03.996248 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:03.996503 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:03.996504 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:03.996769 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:03.996949 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:03.996952 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.997988 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.997990 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:03.998904 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:03.998907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.999485 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.999486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:03.999569 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.000162 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:04.000167 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:04.000498 (+ 331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:04.002600 (+ 2102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:04.002601 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:04.002602 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:04.002886 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:04.003126 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:04.003127 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:04.003127 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:04.003194 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:04.003506 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:04.003507 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:04.003555 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.003635 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.003747 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":120,"threads_started":1}
I20260808 07:07:04.003849 11439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:03.995994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:34355 (local address 127.9.94.62:43931)
0808 07:07:03.996040 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:03.996043 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:03.996214 (+ 171us) server_negotiation.cc:407] Connection header received
0808 07:07:03.996388 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:03.996389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:03.996401 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:03.996486 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:03.997134 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.997745 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.999085 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:03.999378 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:03.999482 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.000696 (+ 1214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:04.000701 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:04.000702 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:04.000710 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:04.002478 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:04.002985 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:04.002987 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:04.002987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:04.003051 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:04.003256 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:04.003257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:04.003258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:04.003427 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:04.003504 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.003660 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.003746 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:07:04.038393 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:43931
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:37069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:04.134143 11747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:04.134442 11747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:04.134493 11747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:04.135808 11747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:04.135888 11747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:04.135932 11747 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 07:07:04.135963 11747 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:07:04.136003 11747 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:04.137822 11747 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:37069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.94.62:43931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:04.138139 11747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:04.138398 11747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:04.144492 11753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:04.144680 11752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:04.144492 11755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:04.145048 11747 server_base.cc:1034] running on GCE node
I20260808 07:07:04.145296 11747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:04.145610 11747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:04.146812 11747 hybrid_clock.cc:648] HybridClock initialized: now 1786172824146782 us; error 39 us; skew 500 ppm
Aug 08 07:07:04 dist-test-slave-77v9 krb5kdc[11342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172824, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:04.150185 11747 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:07:04.150848 11747 webserver.cc:460] Webserver started at http://127.9.94.3:42839/ using document root <none> and password file <none>
I20260808 07:07:04.151129 11747 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:04.151201 11747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:04.151374 11747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:04.153038 11747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "adf54b65e3354539b573d8c5449cf50d"
format_stamp: "Formatted at 2026-08-08 07:07:04 on dist-test-slave-77v9"
server_key: "5b091be56d71940557456405f8e82c8a"
server_key_iv: "76ef9d9f5a546c3b5563d934cc70794b"
server_key_version: "encryptionkey@0"
I20260808 07:07:04.153472 11747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "adf54b65e3354539b573d8c5449cf50d"
format_stamp: "Formatted at 2026-08-08 07:07:04 on dist-test-slave-77v9"
server_key: "5b091be56d71940557456405f8e82c8a"
server_key_iv: "76ef9d9f5a546c3b5563d934cc70794b"
server_key_version: "encryptionkey@0"
I20260808 07:07:04.155395 11747 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260808 07:07:04.156910 11762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:04.157245 11747 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:04.157373 11747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "adf54b65e3354539b573d8c5449cf50d"
format_stamp: "Formatted at 2026-08-08 07:07:04 on dist-test-slave-77v9"
server_key: "5b091be56d71940557456405f8e82c8a"
server_key_iv: "76ef9d9f5a546c3b5563d934cc70794b"
server_key_version: "encryptionkey@0"
I20260808 07:07:04.157466 11747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:04.185956 11747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:04.188730 11747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:04.188963 11747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:04.189677 11747 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:04.189738 11747 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:04.189779 11747 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:04.189831 11747 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:07:04 dist-test-slave-77v9 krb5kdc[11342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172824, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:04.198516 11747 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:43877
I20260808 07:07:04.198596 11881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:43877 every 8 connection(s)
I20260808 07:07:04.199035 11747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:07:04.202243 11439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.190387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:52123 (local address 127.9.94.62:43931)
0808 07:07:04.190473 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.190474 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.190682 (+ 208us) server_negotiation.cc:407] Connection header received
0808 07:07:04.191394 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.191395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.191410 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.191482 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:04.192603 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.193314 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.195314 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.195554 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.195638 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.198286 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:04.198287 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:04.198288 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:04.198297 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:04.200034 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:04.200591 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:04.200592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:04.200592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:04.200654 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:04.201210 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:04.201213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:04.201213 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:04.201446 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:04.201654 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.202057 (+ 403us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.202156 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 07:07:04.202346 11771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.190354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:43931 (local address 127.9.94.3:52123)
0808 07:07:04.190564 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.190601 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.191267 (+ 666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.191605 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.191612 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.192090 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:04.192448 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.192455 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.193412 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.193413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.195191 (+ 1778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.195196 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.195695 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.195697 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.195866 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.196480 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:04.196515 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:04.198158 (+ 1643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:04.200209 (+ 2051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:04.200215 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:04.200217 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:04.200477 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:04.200786 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:04.200787 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:04.200787 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:04.201033 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:04.201659 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:04.201671 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:04.201814 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.201984 (+ 170us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.202158 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":113,"threads_started":1}
I20260808 07:07:04.202940 11882 heartbeater.cc:347] Connected to a master server at 127.9.94.62:43931
I20260808 07:07:04.203042 11882 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:04.203255 11882 heartbeater.cc:511] Master 127.9.94.62:43931 requested a full tablet report, sending...
I20260808 07:07:04.203691 11388 ts_manager.cc:194] Registered new tserver with Master: adf54b65e3354539b573d8c5449cf50d (127.9.94.3:43877)
I20260808 07:07:04.204214 11388 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:52123
I20260808 07:07:04.205992 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 11747
I20260808 07:07:04.206121 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:07:04.206364 9592 external_mini_cluster.cc:1428] Setting key 712331cf475bbe2f7d6f4e2fd2c206a0
I20260808 07:07:04.207873 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:07:04.212005 11439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.204505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:45971 (local address 127.9.94.62:43931)
0808 07:07:04.204560 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.204563 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.204790 (+ 227us) server_negotiation.cc:407] Connection header received
0808 07:07:04.204913 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.204914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.204928 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.205000 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:04.205400 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.206077 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.207151 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.207377 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.207470 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.208698 (+ 1228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:04.208700 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:04.208700 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:04.208709 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:04.210533 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:04.211077 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:04.211078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:04.211078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:04.211140 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:04.211425 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:04.211426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:04.211426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:04.211547 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:04.211608 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.211818 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.211919 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:07:04.212085 11888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.204465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:43931 (local address 127.9.94.3:45971)
0808 07:07:04.204646 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.204659 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.204809 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.205007 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.205008 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.205236 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:04.205299 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.205301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.206242 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.206244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.207041 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.207045 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.207483 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.207484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.207579 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.208175 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:04.208180 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:04.208556 (+ 376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:04.210671 (+ 2115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:04.210672 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:04.210673 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:04.210975 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:04.211225 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:04.211225 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:04.211226 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:04.211314 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:04.211606 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:04.211607 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:04.211666 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.211780 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.211929 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":119,"threads_started":1}
Aug 08 07:07:04 dist-test-slave-77v9 krb5kdc[11342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 07:07:04 dist-test-slave-77v9 krb5kdc[11342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:04.238355 11439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.228896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36716 (local address 127.9.94.62:43931)
0808 07:07:04.228965 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.228967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.228983 (+ 16us) server_negotiation.cc:407] Connection header received
0808 07:07:04.229011 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.229012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.229022 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.229100 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:04.229943 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.230473 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.231535 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.231743 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.231809 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.234977 (+ 3168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:04.234979 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:04.234979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:04.234988 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:04.236550 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:04.237120 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:04.237121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:04.237121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:04.237187 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:04.237629 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:04.237631 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:04.237632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:04.237825 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:04.237949 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.238169 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.238257 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 07:07:04.240284 11388 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36716:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:07:04.242023 11388 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:04.250066 11901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.245379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:43615 (local address 127.0.0.1:46032)
0808 07:07:04.245925 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.245939 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.246028 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.246294 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.246298 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.246300 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:04.246485 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.246488 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.247529 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.247531 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.248652 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.248655 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.249694 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.249696 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.249791 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.249807 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.249899 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.249959 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"mutex_wait_us":86,"thread_start_us":67,"threads_started":1}
I20260808 07:07:04.250099 11903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.245620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46032 (local address 127.9.94.1:43615)
0808 07:07:04.245850 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.245854 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.246036 (+ 182us) server_negotiation.cc:407] Connection header received
0808 07:07:04.246124 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.246127 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.246146 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.246234 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:04.246598 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.247422 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.248780 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.249484 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.249571 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.249639 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.249931 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.249978 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":110,"threads_started":1}
I20260808 07:07:04.250666 11899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.245408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:43877 (local address 127.0.0.1:55596)
0808 07:07:04.246132 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.246142 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.246194 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.246400 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.246401 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.246402 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:04.246506 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.246509 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.247481 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.247482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.249133 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.249137 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.250367 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.250368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.250435 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.250441 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.250528 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.250579 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"mutex_wait_us":189,"thread_start_us":132,"threads_started":1}
I20260808 07:07:04.250728 11904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.245789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55596 (local address 127.9.94.3:43877)
0808 07:07:04.246002 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.246101 (+ 99us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.246198 (+ 97us) server_negotiation.cc:407] Connection header received
0808 07:07:04.246276 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.246278 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.246297 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.246385 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:04.246582 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.247386 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.249325 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.250147 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.250252 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.250319 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.250549 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.250595 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":115,"threads_started":1}
I20260808 07:07:04.251012 11527 tablet_service.cc:1467] Processing CreateTablet for tablet 82bc078cfdfb47b3b67ef795b42d1b8e (DEFAULT_TABLE table=test-table [id=00ad174a7d2840b7a3708521e4355235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:04.251472 11527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82bc078cfdfb47b3b67ef795b42d1b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:04.251451 11814 tablet_service.cc:1467] Processing CreateTablet for tablet 82bc078cfdfb47b3b67ef795b42d1b8e (DEFAULT_TABLE table=test-table [id=00ad174a7d2840b7a3708521e4355235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:04.251883 11814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82bc078cfdfb47b3b67ef795b42d1b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:04.252115 11900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.245379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:38515 (local address 127.0.0.1:41746)
0808 07:07:04.245838 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.245889 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.245979 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.246321 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.246322 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.246325 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:04.247575 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.247578 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.249265 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.249265 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.250600 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.250604 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.251832 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.251833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.251918 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.251923 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.251985 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.252033 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":1180,"spinlock_wait_cycles":1280,"thread_start_us":111,"threads_started":1}
I20260808 07:07:04.252386 11902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.245607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41746 (local address 127.9.94.2:38515)
0808 07:07:04.245812 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.245819 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.246105 (+ 286us) server_negotiation.cc:407] Connection header received
0808 07:07:04.246150 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.246152 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.246171 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.246255 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:04.247688 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.249166 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.250714 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.251644 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.251730 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.251788 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.252229 (+ 441us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.252273 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":111,"threads_started":1}
I20260808 07:07:04.253650 11671 tablet_service.cc:1467] Processing CreateTablet for tablet 82bc078cfdfb47b3b67ef795b42d1b8e (DEFAULT_TABLE table=test-table [id=00ad174a7d2840b7a3708521e4355235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:04.254042 11671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82bc078cfdfb47b3b67ef795b42d1b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:04.255652 11905 tablet_bootstrap.cc:492] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d: Bootstrap starting.
I20260808 07:07:04.256147 11906 tablet_bootstrap.cc:492] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903: Bootstrap starting.
I20260808 07:07:04.257026 11905 tablet_bootstrap.cc:654] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:04.257020 11906 tablet_bootstrap.cc:654] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:04.257445 11905 log.cc:824] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:04.257445 11906 log.cc:824] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:04.257884 11909 tablet_bootstrap.cc:492] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30: Bootstrap starting.
I20260808 07:07:04.258360 11905 tablet_bootstrap.cc:492] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d: No bootstrap required, opened a new log
I20260808 07:07:04.258456 11905 ts_tablet_manager.cc:1397] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:07:04.258477 11906 tablet_bootstrap.cc:492] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903: No bootstrap required, opened a new log
I20260808 07:07:04.258548 11906 ts_tablet_manager.cc:1397] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:07:04.260144 11906 raft_consensus.cc:348] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.260314 11906 raft_consensus.cc:374] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:04.260347 11906 raft_consensus.cc:729] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5580656ad96740bca8c6a45b31c3d903, State: Initialized, Role: FOLLOWER
I20260808 07:07:04.260218 11905 raft_consensus.cc:348] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.260389 11905 raft_consensus.cc:374] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:04.260445 11905 raft_consensus.cc:729] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf54b65e3354539b573d8c5449cf50d, State: Initialized, Role: FOLLOWER
I20260808 07:07:04.260507 11906 consensus_queue.cc:260] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.260578 11905 consensus_queue.cc:260] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.260919 11906 ts_tablet_manager.cc:1428] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 07:07:04.260965 11905 ts_tablet_manager.cc:1428] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:07:04.260975 11596 heartbeater.cc:503] Master 127.9.94.62:43931 was elected leader, sending a full tablet report...
I20260808 07:07:04.261307 11882 heartbeater.cc:503] Master 127.9.94.62:43931 was elected leader, sending a full tablet report...
I20260808 07:07:04.261461 11909 tablet_bootstrap.cc:654] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:04.261910 11909 log.cc:824] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:04.263036 11909 tablet_bootstrap.cc:492] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30: No bootstrap required, opened a new log
I20260808 07:07:04.263134 11909 ts_tablet_manager.cc:1397] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260808 07:07:04.264779 11909 raft_consensus.cc:348] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.265033 11909 raft_consensus.cc:374] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:04.265092 11909 raft_consensus.cc:729] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c0f715f33bf486b80f47137c8c8ae30, State: Initialized, Role: FOLLOWER
I20260808 07:07:04.265249 11909 consensus_queue.cc:260] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.265580 11909 ts_tablet_manager.cc:1428] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:07:04.265694 11738 heartbeater.cc:503] Master 127.9.94.62:43931 was elected leader, sending a full tablet report...
I20260808 07:07:04.267658 11913 raft_consensus.cc:482] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:04.267750 11913 raft_consensus.cc:504] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.268083 11913 leader_election.cc:288] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5580656ad96740bca8c6a45b31c3d903 (127.9.94.1:43615), adf54b65e3354539b573d8c5449cf50d (127.9.94.3:43877)
I20260808 07:07:04.271229 11903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.268369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:51511 (local address 127.9.94.1:43615)
0808 07:07:04.268422 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.268424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.268573 (+ 149us) server_negotiation.cc:407] Connection header received
0808 07:07:04.268649 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.268650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.268663 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.268727 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:04.268897 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.269413 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.270442 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.270845 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.270932 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.270943 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.271111 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.271150 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:07:04.271271 11914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.268289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:43615 (local address 127.9.94.2:51511)
0808 07:07:04.268500 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.268509 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.268589 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.268732 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.268733 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.268735 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:04.268835 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.268837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.269508 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.269509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.270335 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.270337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.270932 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.270933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.271016 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.271020 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.271101 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.271143 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":143,"threads_started":1}
I20260808 07:07:04.271296 11904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.268385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:38069 (local address 127.9.94.3:43877)
0808 07:07:04.268438 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.268440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.268448 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:07:04.268474 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.268474 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.268483 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.268533 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:04.268680 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.269263 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.270441 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.270860 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.270953 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.270963 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.271178 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.271219 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:07:04.271411 11630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.268253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:43877 (local address 127.9.94.2:38069)
0808 07:07:04.268295 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.268310 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.268406 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.268533 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.268534 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.268536 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:04.268607 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.268609 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.269353 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.269354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.270307 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.270310 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.270952 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.270953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.271089 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.271092 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.271157 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.271205 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260808 07:07:04.271687 11547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82bc078cfdfb47b3b67ef795b42d1b8e" candidate_uuid: "4c0f715f33bf486b80f47137c8c8ae30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5580656ad96740bca8c6a45b31c3d903" is_pre_election: true
I20260808 07:07:04.271747 11834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82bc078cfdfb47b3b67ef795b42d1b8e" candidate_uuid: "4c0f715f33bf486b80f47137c8c8ae30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf54b65e3354539b573d8c5449cf50d" is_pre_election: true
I20260808 07:07:04.271853 11547 raft_consensus.cc:2454] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c0f715f33bf486b80f47137c8c8ae30 in term 0.
I20260808 07:07:04.271911 11834 raft_consensus.cc:2454] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c0f715f33bf486b80f47137c8c8ae30 in term 0.
I20260808 07:07:04.272132 11624 leader_election.cc:302] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c0f715f33bf486b80f47137c8c8ae30, 5580656ad96740bca8c6a45b31c3d903; no voters:
I20260808 07:07:04.272297 11913 raft_consensus.cc:2781] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:04.272361 11913 raft_consensus.cc:482] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:04.272392 11913 raft_consensus.cc:3037] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:04.273448 11913 raft_consensus.cc:504] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.273706 11913 leader_election.cc:288] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [CANDIDATE]: Term 1 election: Requested vote from peers 5580656ad96740bca8c6a45b31c3d903 (127.9.94.1:43615), adf54b65e3354539b573d8c5449cf50d (127.9.94.3:43877)
I20260808 07:07:04.273811 11834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82bc078cfdfb47b3b67ef795b42d1b8e" candidate_uuid: "4c0f715f33bf486b80f47137c8c8ae30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf54b65e3354539b573d8c5449cf50d"
I20260808 07:07:04.273927 11834 raft_consensus.cc:3037] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:04.273931 11547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82bc078cfdfb47b3b67ef795b42d1b8e" candidate_uuid: "4c0f715f33bf486b80f47137c8c8ae30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5580656ad96740bca8c6a45b31c3d903"
I20260808 07:07:04.274016 11547 raft_consensus.cc:3037] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:04.274942 11547 raft_consensus.cc:2454] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c0f715f33bf486b80f47137c8c8ae30 in term 1.
I20260808 07:07:04.275087 11834 raft_consensus.cc:2454] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c0f715f33bf486b80f47137c8c8ae30 in term 1.
I20260808 07:07:04.275229 11624 leader_election.cc:302] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c0f715f33bf486b80f47137c8c8ae30, 5580656ad96740bca8c6a45b31c3d903; no voters:
I20260808 07:07:04.275383 11913 raft_consensus.cc:2781] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:04.275624 11913 raft_consensus.cc:686] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 LEADER]: Becoming Leader. State: Replica: 4c0f715f33bf486b80f47137c8c8ae30, State: Running, Role: LEADER
I20260808 07:07:04.275774 11913 consensus_queue.cc:237] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.277052 11387 catalog_manager.cc:5495] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c0f715f33bf486b80f47137c8c8ae30 (127.9.94.2). New cstate: current_term: 1 leader_uuid: "4c0f715f33bf486b80f47137c8c8ae30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } health_report { overall_health: UNKNOWN } } }
W20260808 07:07:04.306504 11597 tablet.cc:2369] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 07:07:04 dist-test-slave-77v9 krb5kdc[11342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172823, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:04.321939 11439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.313790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36728 (local address 127.9.94.62:43931)
0808 07:07:04.313899 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.313901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.314039 (+ 138us) server_negotiation.cc:407] Connection header received
0808 07:07:04.314082 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.314083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.314093 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.314306 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:04.314818 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.315358 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.316103 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.316283 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.316346 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.318839 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:04.318840 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:04.318840 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:04.318848 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:04.320275 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:04.320761 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:04.320762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:04.320763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:04.321023 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:04.321301 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:04.321303 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:04.321303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:04.321450 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:04.321520 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.321744 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.321824 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 07:07:04.322083 11923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.313706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:43931 (local address 127.0.0.1:36728)
0808 07:07:04.313929 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.313941 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.314013 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.314326 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.314327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.314641 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:04.314692 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.314695 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.315456 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.315457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.315993 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.315995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.316383 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.316384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.316434 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.317067 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:04.317071 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:04.318686 (+ 1615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:04.320405 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:04.320413 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:04.320416 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:04.320642 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:04.321110 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:04.321111 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:04.321111 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:04.321189 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:04.321562 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:04.321575 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:04.321629 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.321706 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.321914 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":54,"thread_start_us":89,"threads_started":1}
I20260808 07:07:04.324492 11387 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:36728:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 07:07:04.324704 11387 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:04.326946 11671 tablet_service.cc:1467] Processing CreateTablet for tablet 98bb194616a34009953ddd94b5ef55bd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3e36904370e049e0a44a56746685e507]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:07:04.326948 11527 tablet_service.cc:1467] Processing CreateTablet for tablet 98bb194616a34009953ddd94b5ef55bd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3e36904370e049e0a44a56746685e507]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:07:04.326951 11814 tablet_service.cc:1467] Processing CreateTablet for tablet 98bb194616a34009953ddd94b5ef55bd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3e36904370e049e0a44a56746685e507]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:07:04.327111 11671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98bb194616a34009953ddd94b5ef55bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:04.327114 11814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98bb194616a34009953ddd94b5ef55bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:04.327114 11527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98bb194616a34009953ddd94b5ef55bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:04.329097 11905 tablet_bootstrap.cc:492] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d: Bootstrap starting.
I20260808 07:07:04.329173 11909 tablet_bootstrap.cc:492] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30: Bootstrap starting.
I20260808 07:07:04.329620 11909 tablet_bootstrap.cc:654] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:04.329648 11905 tablet_bootstrap.cc:654] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:04.329998 11906 tablet_bootstrap.cc:492] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903: Bootstrap starting.
I20260808 07:07:04.330425 11909 tablet_bootstrap.cc:492] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30: No bootstrap required, opened a new log
I20260808 07:07:04.330483 11906 tablet_bootstrap.cc:654] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:04.330490 11909 ts_tablet_manager.cc:1397] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:04.330610 11905 tablet_bootstrap.cc:492] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d: No bootstrap required, opened a new log
I20260808 07:07:04.330714 11905 ts_tablet_manager.cc:1397] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260808 07:07:04.330681 11909 raft_consensus.cc:348] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.330816 11909 raft_consensus.cc:374] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:04.330850 11909 raft_consensus.cc:729] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c0f715f33bf486b80f47137c8c8ae30, State: Initialized, Role: FOLLOWER
I20260808 07:07:04.330919 11909 consensus_queue.cc:260] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.330909 11905 raft_consensus.cc:348] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.331019 11905 raft_consensus.cc:374] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:04.331043 11909 ts_tablet_manager.cc:1428] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:04.331056 11905 raft_consensus.cc:729] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf54b65e3354539b573d8c5449cf50d, State: Initialized, Role: FOLLOWER
I20260808 07:07:04.331127 11905 consensus_queue.cc:260] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.331243 11905 ts_tablet_manager.cc:1428] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:04.331411 11913 tablet_replica.cc:439] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } } }
I20260808 07:07:04.331523 11913 tablet_replica.cc:442] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:04.331568 11906 tablet_bootstrap.cc:492] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903: No bootstrap required, opened a new log
I20260808 07:07:04.331630 11906 ts_tablet_manager.cc:1397] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:07:04.331733 11911 tablet_replica.cc:439] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } } }
I20260808 07:07:04.331790 11906 raft_consensus.cc:348] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.331873 11906 raft_consensus.cc:374] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:04.331863 11911 tablet_replica.cc:442] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:04.331902 11906 raft_consensus.cc:729] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5580656ad96740bca8c6a45b31c3d903, State: Initialized, Role: FOLLOWER
I20260808 07:07:04.331950 11906 consensus_queue.cc:260] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.332087 11906 ts_tablet_manager.cc:1428] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:07:04.332178 11910 tablet_replica.cc:439] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } } }
I20260808 07:07:04.332288 11910 tablet_replica.cc:442] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:04.345638 11911 raft_consensus.cc:482] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:04.345769 11911 raft_consensus.cc:504] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.346141 11911 leader_election.cc:288] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5580656ad96740bca8c6a45b31c3d903 (127.9.94.1:43615), 4c0f715f33bf486b80f47137c8c8ae30 (127.9.94.2:38515)
I20260808 07:07:04.349462 11902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.346532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:46727 (local address 127.9.94.2:38515)
0808 07:07:04.346592 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.346595 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.346739 (+ 144us) server_negotiation.cc:407] Connection header received
0808 07:07:04.346804 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.346804 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.346815 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.346884 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:04.347057 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.347590 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.348622 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.349062 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.349152 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.349164 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.349346 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.349381 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 07:07:04.349588 11771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.346387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:43615 (local address 127.9.94.3:35117)
0808 07:07:04.346484 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.346498 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.346555 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.346880 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.346881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.346883 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:04.346995 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.346997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.347745 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.347746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.348527 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.348529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.349217 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.349219 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.349299 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.349303 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.349418 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.349467 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"mutex_wait_us":32}
I20260808 07:07:04.349560 11903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.346525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:35117 (local address 127.9.94.1:43615)
0808 07:07:04.346581 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.346583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.346597 (+ 14us) server_negotiation.cc:407] Connection header received
0808 07:07:04.346730 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.346732 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.346748 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.346873 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:04.347082 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.347626 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.348631 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.349109 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.349200 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.349213 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.349428 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.349473 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:07:04.349499 11927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.346405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:38515 (local address 127.9.94.3:46727)
0808 07:07:04.346673 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.346681 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.346748 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.346886 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.346887 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.346889 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:04.346989 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.346991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.347676 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.347677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.348521 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.348524 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.349190 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.349191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.349261 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.349265 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.349338 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.349380 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"mutex_wait_us":28,"thread_start_us":142,"threads_started":1}
I20260808 07:07:04.349850 11547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98bb194616a34009953ddd94b5ef55bd" candidate_uuid: "adf54b65e3354539b573d8c5449cf50d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5580656ad96740bca8c6a45b31c3d903" is_pre_election: true
I20260808 07:07:04.349961 11547 raft_consensus.cc:2454] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf54b65e3354539b573d8c5449cf50d in term 0.
I20260808 07:07:04.349911 11692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98bb194616a34009953ddd94b5ef55bd" candidate_uuid: "adf54b65e3354539b573d8c5449cf50d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c0f715f33bf486b80f47137c8c8ae30" is_pre_election: true
I20260808 07:07:04.350042 11692 raft_consensus.cc:2454] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf54b65e3354539b573d8c5449cf50d in term 0.
I20260808 07:07:04.350205 11765 leader_election.cc:302] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5580656ad96740bca8c6a45b31c3d903, adf54b65e3354539b573d8c5449cf50d; no voters:
I20260808 07:07:04.350396 11911 raft_consensus.cc:2781] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:04.350458 11911 raft_consensus.cc:482] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:04.350482 11911 raft_consensus.cc:3037] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:04.351331 11911 raft_consensus.cc:504] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.351485 11911 leader_election.cc:288] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [CANDIDATE]: Term 1 election: Requested vote from peers 5580656ad96740bca8c6a45b31c3d903 (127.9.94.1:43615), 4c0f715f33bf486b80f47137c8c8ae30 (127.9.94.2:38515)
I20260808 07:07:04.351642 11692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98bb194616a34009953ddd94b5ef55bd" candidate_uuid: "adf54b65e3354539b573d8c5449cf50d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c0f715f33bf486b80f47137c8c8ae30"
I20260808 07:07:04.351665 11547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98bb194616a34009953ddd94b5ef55bd" candidate_uuid: "adf54b65e3354539b573d8c5449cf50d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5580656ad96740bca8c6a45b31c3d903"
I20260808 07:07:04.351734 11692 raft_consensus.cc:3037] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:04.351734 11547 raft_consensus.cc:3037] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:04.352550 11692 raft_consensus.cc:2454] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf54b65e3354539b573d8c5449cf50d in term 1.
I20260808 07:07:04.352550 11547 raft_consensus.cc:2454] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf54b65e3354539b573d8c5449cf50d in term 1.
I20260808 07:07:04.352897 11764 leader_election.cc:302] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c0f715f33bf486b80f47137c8c8ae30, adf54b65e3354539b573d8c5449cf50d; no voters:
I20260808 07:07:04.353003 11911 raft_consensus.cc:2781] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:04.353163 11911 raft_consensus.cc:686] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [term 1 LEADER]: Becoming Leader. State: Replica: adf54b65e3354539b573d8c5449cf50d, State: Running, Role: LEADER
I20260808 07:07:04.353291 11911 consensus_queue.cc:237] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.353915 11928 tablet_replica.cc:439] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d: TxnStatusTablet state changed. Reason: New leader adf54b65e3354539b573d8c5449cf50d. Latest consensus state: current_term: 1 leader_uuid: "adf54b65e3354539b573d8c5449cf50d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } } }
I20260808 07:07:04.354007 11928 tablet_replica.cc:442] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:07:04.354231 11930 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 07:07:04.354367 11930 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 07:07:04.354498 11387 catalog_manager.cc:5495] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d reported cstate change: term changed from 0 to 1, leader changed from <none> to adf54b65e3354539b573d8c5449cf50d (127.9.94.3). New cstate: current_term: 1 leader_uuid: "adf54b65e3354539b573d8c5449cf50d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } health_report { overall_health: HEALTHY } } }
I20260808 07:07:04.363519 11904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.360301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55612 (local address 127.9.94.3:43877)
0808 07:07:04.360385 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.360388 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.360399 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:04.360451 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.360452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.360476 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.360708 (+ 232us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:04.360920 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.361465 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.362617 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.362837 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.362900 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.363143 (+ 243us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:04.363257 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:04.363352 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.363436 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.363459 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 07:07:04.363583 11923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.360134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:43877 (local address 127.0.0.1:55612)
0808 07:07:04.360240 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.360253 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.360308 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.360724 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.360725 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.360726 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:07:04.360788 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.360791 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.361541 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.361542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.362504 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.362507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.362927 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.362928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.362997 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.363019 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:07:04.363358 (+ 339us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:07:04.363371 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.363433 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.363490 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 07:07:04.365514 11547 raft_consensus.cc:1261] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903 [term 1 FOLLOWER]: Refusing update from remote peer adf54b65e3354539b573d8c5449cf50d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:04.365826 11911 consensus_queue.cc:1035] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:04.365875 11692 raft_consensus.cc:1261] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 FOLLOWER]: Refusing update from remote peer adf54b65e3354539b573d8c5449cf50d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:04.366125 11911 consensus_queue.cc:1035] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:04.367074 11910 tablet_replica.cc:439] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903: TxnStatusTablet state changed. Reason: New leader adf54b65e3354539b573d8c5449cf50d. Latest consensus state: current_term: 1 leader_uuid: "adf54b65e3354539b573d8c5449cf50d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } } }
I20260808 07:07:04.367173 11910 tablet_replica.cc:442] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:04.367350 11913 tablet_replica.cc:439] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30: TxnStatusTablet state changed. Reason: New leader adf54b65e3354539b573d8c5449cf50d. Latest consensus state: current_term: 1 leader_uuid: "adf54b65e3354539b573d8c5449cf50d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } } }
I20260808 07:07:04.367444 11913 tablet_replica.cc:442] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:04.368832 11928 tablet_replica.cc:439] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "adf54b65e3354539b573d8c5449cf50d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } } }
I20260808 07:07:04.368929 11928 tablet_replica.cc:442] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:07:04.369012 11928 tablet_replica.cc:439] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "adf54b65e3354539b573d8c5449cf50d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } } }
I20260808 07:07:04.369082 11928 tablet_replica.cc:442] T 98bb194616a34009953ddd94b5ef55bd P adf54b65e3354539b573d8c5449cf50d: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:07:04.369158 11933 mvcc.cc:205] Tried to move back new op lower bound from 7316163888597995520 to 7316163888551813120. Current Snapshot: MvccSnapshot[applied={T|T < 7316163888597995520}]
I20260808 07:07:04.369288 11913 tablet_replica.cc:439] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "adf54b65e3354539b573d8c5449cf50d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } } }
I20260808 07:07:04.369359 11935 mvcc.cc:205] Tried to move back new op lower bound from 7316163888597995520 to 7316163888551813120. Current Snapshot: MvccSnapshot[applied={T|T < 7316163888597995520}]
I20260808 07:07:04.369402 11913 tablet_replica.cc:442] T 98bb194616a34009953ddd94b5ef55bd P 4c0f715f33bf486b80f47137c8c8ae30: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:04.369441 11910 tablet_replica.cc:439] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "adf54b65e3354539b573d8c5449cf50d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } } }
I20260808 07:07:04.369524 11910 tablet_replica.cc:442] T 98bb194616a34009953ddd94b5ef55bd P 5580656ad96740bca8c6a45b31c3d903: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:04.370013 11937 mvcc.cc:205] Tried to move back new op lower bound from 7316163888597995520 to 7316163888551813120. Current Snapshot: MvccSnapshot[applied={T|T < 7316163888597995520}]
I20260808 07:07:04.375856 11902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.372608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41762 (local address 127.9.94.2:38515)
0808 07:07:04.372661 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.372663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.372707 (+ 44us) server_negotiation.cc:407] Connection header received
0808 07:07:04.372788 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.372789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.372851 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.372936 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:04.373230 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.374026 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.374971 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.375203 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.375285 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.375482 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:04.375597 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:04.375696 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.375721 (+ 25us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.375748 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:07:04.381981 11904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.378907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:53341 (local address 127.9.94.3:43877)
0808 07:07:04.378954 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.378956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.379040 (+ 84us) server_negotiation.cc:407] Connection header received
0808 07:07:04.379105 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.379106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.379116 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.379163 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:04.379312 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.379840 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.381174 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.381444 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.381504 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.381722 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:04.381748 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:04.381786 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.381845 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.381907 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:07:04.381978 11744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.378791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:43877 (local address 127.9.94.2:53341)
0808 07:07:04.378976 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.378988 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.379044 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.379181 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.379181 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.379183 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:07:04.379250 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.379251 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.379965 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.379966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.381044 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.381047 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.381530 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.381531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.381601 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.381619 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:07:04.381791 (+ 172us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:07:04.381793 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.381843 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.381888 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
I20260808 07:07:04.384984 11547 raft_consensus.cc:1261] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903 [term 1 FOLLOWER]: Refusing update from remote peer 4c0f715f33bf486b80f47137c8c8ae30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:04.385119 11834 raft_consensus.cc:1261] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Refusing update from remote peer 4c0f715f33bf486b80f47137c8c8ae30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:04.385293 11915 consensus_queue.cc:1035] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:04.385413 11913 consensus_queue.cc:1035] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:04.399202 11902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.395622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:36627 (local address 127.9.94.2:38515)
0808 07:07:04.395842 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.395844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.395852 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:07:04.395874 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.395875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.395887 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.395943 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:04.396140 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.396931 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.398018 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.398305 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.398390 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.398576 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:04.398612 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:04.398660 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.398960 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.399005 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198}
I20260808 07:07:04.399202 11888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.395597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:38515 (local address 127.9.94.3:36627)
0808 07:07:04.395683 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.395695 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.395741 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.395974 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.395975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.395977 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:07:04.396048 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.396050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.397030 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.397032 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.397927 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.397930 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.398392 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.398393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.398457 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.398481 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:07:04.398793 (+ 312us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:07:04.398801 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.398928 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.399024 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 07:07:04.410115 11388 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:04.410255 11388 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:04.411118 11388 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827: Sending DeleteTablet for 3 replicas of tablet 82bc078cfdfb47b3b67ef795b42d1b8e
I20260808 07:07:04.411444 11671 tablet_service.cc:1514] Processing DeleteTablet for tablet 82bc078cfdfb47b3b67ef795b42d1b8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:04 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:41746
I20260808 07:07:04.411476 11814 tablet_service.cc:1514] Processing DeleteTablet for tablet 82bc078cfdfb47b3b67ef795b42d1b8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:04 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:55596
I20260808 07:07:04.411765 11954 tablet_replica.cc:330] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d: stopping tablet replica
I20260808 07:07:04.411916 11954 raft_consensus.cc:2229] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:04.411974 11954 raft_consensus.cc:2258] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:04.411964 11527 tablet_service.cc:1514] Processing DeleteTablet for tablet 82bc078cfdfb47b3b67ef795b42d1b8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:04 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:46032
I20260808 07:07:04.412465 11954 ts_tablet_manager.cc:1905] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:04.412619 11388 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36716:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:07:04.412776 11388 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:04.414227 11814 tablet_service.cc:1467] Processing CreateTablet for tablet 9849b3124569486a9b70f59fd08020b3 (DEFAULT_TABLE table=test-table [id=f4ac9c3edf43475a811cbf045fadc664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:04.414662 11814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9849b3124569486a9b70f59fd08020b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:04.414830 11671 tablet_service.cc:1467] Processing CreateTablet for tablet 9849b3124569486a9b70f59fd08020b3 (DEFAULT_TABLE table=test-table [id=f4ac9c3edf43475a811cbf045fadc664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:04.415115 11671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9849b3124569486a9b70f59fd08020b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:04.416004 11905 tablet_bootstrap.cc:492] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d: Bootstrap starting.
I20260808 07:07:04.416460 11905 tablet_bootstrap.cc:654] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:04.417168 11954 ts_tablet_manager.cc:1918] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:07:04.417250 11954 log.cc:1196] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/82bc078cfdfb47b3b67ef795b42d1b8e
I20260808 07:07:04.417426 11527 tablet_service.cc:1467] Processing CreateTablet for tablet 9849b3124569486a9b70f59fd08020b3 (DEFAULT_TABLE table=test-table [id=f4ac9c3edf43475a811cbf045fadc664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:04.417546 11954 ts_tablet_manager.cc:1939] T 82bc078cfdfb47b3b67ef795b42d1b8e P adf54b65e3354539b573d8c5449cf50d: Deleting consensus metadata
I20260808 07:07:04.417562 11527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9849b3124569486a9b70f59fd08020b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:04.417989 11371 catalog_manager.cc:4841] TS adf54b65e3354539b573d8c5449cf50d (127.9.94.3:43877): tablet 82bc078cfdfb47b3b67ef795b42d1b8e (table test-table [id=00ad174a7d2840b7a3708521e4355235]) successfully deleted
I20260808 07:07:04.418453 11905 tablet_bootstrap.cc:492] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d: No bootstrap required, opened a new log
I20260808 07:07:04.418495 11905 ts_tablet_manager.cc:1397] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20260808 07:07:04.418638 11905 raft_consensus.cc:348] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.418705 11905 raft_consensus.cc:374] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:04.418725 11905 raft_consensus.cc:729] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf54b65e3354539b573d8c5449cf50d, State: Initialized, Role: FOLLOWER
I20260808 07:07:04.418771 11905 consensus_queue.cc:260] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.418856 11905 ts_tablet_manager.cc:1428] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:04.419049 11906 tablet_bootstrap.cc:492] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903: Bootstrap starting.
I20260808 07:07:04.419458 11906 tablet_bootstrap.cc:654] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:04.419952 11955 tablet_replica.cc:330] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903: stopping tablet replica
I20260808 07:07:04.420256 11906 tablet_bootstrap.cc:492] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903: No bootstrap required, opened a new log
I20260808 07:07:04.420322 11906 ts_tablet_manager.cc:1397] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:04.420339 11909 tablet_bootstrap.cc:492] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30: Bootstrap starting.
I20260808 07:07:04.420504 11953 tablet_replica.cc:330] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30: stopping tablet replica
I20260808 07:07:04.420482 11906 raft_consensus.cc:348] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.420578 11906 raft_consensus.cc:374] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:04.420604 11906 raft_consensus.cc:729] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5580656ad96740bca8c6a45b31c3d903, State: Initialized, Role: FOLLOWER
I20260808 07:07:04.420616 11953 raft_consensus.cc:2229] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:07:04.420656 11906 consensus_queue.cc:260] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.420728 11953 raft_consensus.cc:2258] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:04.420792 11906 ts_tablet_manager.cc:1428] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:07:04.420794 11909 tablet_bootstrap.cc:654] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:04.420089 11955 raft_consensus.cc:2229] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:04.421450 11955 raft_consensus.cc:2258] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:04.421617 11953 ts_tablet_manager.cc:1905] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:04.424104 11953 ts_tablet_manager.cc:1918] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:07:04.424220 11953 log.cc:1196] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/82bc078cfdfb47b3b67ef795b42d1b8e
I20260808 07:07:04.424535 11953 ts_tablet_manager.cc:1939] T 82bc078cfdfb47b3b67ef795b42d1b8e P 4c0f715f33bf486b80f47137c8c8ae30: Deleting consensus metadata
I20260808 07:07:04.425262 11955 ts_tablet_manager.cc:1905] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:04.425285 11909 tablet_bootstrap.cc:492] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30: No bootstrap required, opened a new log
I20260808 07:07:04.425266 11372 catalog_manager.cc:4841] TS 4c0f715f33bf486b80f47137c8c8ae30 (127.9.94.2:38515): tablet 82bc078cfdfb47b3b67ef795b42d1b8e (table test-table [id=00ad174a7d2840b7a3708521e4355235]) successfully deleted
I20260808 07:07:04.425336 11909 ts_tablet_manager.cc:1397] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260808 07:07:04.425503 11909 raft_consensus.cc:348] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.425581 11909 raft_consensus.cc:374] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:04.425604 11909 raft_consensus.cc:729] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c0f715f33bf486b80f47137c8c8ae30, State: Initialized, Role: FOLLOWER
I20260808 07:07:04.425652 11909 consensus_queue.cc:260] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.425742 11909 ts_tablet_manager.cc:1428] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:04.427347 11955 ts_tablet_manager.cc:1918] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:07:04.427470 11955 log.cc:1196] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/wal/wals/82bc078cfdfb47b3b67ef795b42d1b8e
I20260808 07:07:04.427742 11955 ts_tablet_manager.cc:1939] T 82bc078cfdfb47b3b67ef795b42d1b8e P 5580656ad96740bca8c6a45b31c3d903: Deleting consensus metadata
I20260808 07:07:04.428337 11373 catalog_manager.cc:4841] TS 5580656ad96740bca8c6a45b31c3d903 (127.9.94.1:43615): tablet 82bc078cfdfb47b3b67ef795b42d1b8e (table test-table [id=00ad174a7d2840b7a3708521e4355235]) successfully deleted
I20260808 07:07:04.435595 11910 raft_consensus.cc:482] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:04.435705 11910 raft_consensus.cc:504] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.436045 11910 leader_election.cc:288] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c0f715f33bf486b80f47137c8c8ae30 (127.9.94.2:38515), adf54b65e3354539b573d8c5449cf50d (127.9.94.3:43877)
I20260808 07:07:04.440711 11902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.436529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:54583 (local address 127.9.94.2:38515)
0808 07:07:04.436593 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.436595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.436986 (+ 391us) server_negotiation.cc:407] Connection header received
0808 07:07:04.437083 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.437084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.437094 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.437125 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:04.437346 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.438107 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.439750 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.440294 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.440344 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.440357 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.440590 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.440628 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 07:07:04.441442 11960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.436249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:38515 (local address 127.9.94.1:54583)
0808 07:07:04.436922 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.436933 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.437013 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.437188 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.437189 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.437190 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:04.437269 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.437271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.438211 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.438211 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.439641 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.439645 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.440424 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.440425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.440505 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.440510 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.441266 (+ 756us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.441323 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"mutex_wait_us":72,"thread_start_us":93,"threads_started":1}
I20260808 07:07:04.441848 11692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9849b3124569486a9b70f59fd08020b3" candidate_uuid: "5580656ad96740bca8c6a45b31c3d903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c0f715f33bf486b80f47137c8c8ae30" is_pre_election: true
I20260808 07:07:04.441967 11692 raft_consensus.cc:2454] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5580656ad96740bca8c6a45b31c3d903 in term 0.
I20260808 07:07:04.442144 11479 leader_election.cc:302] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c0f715f33bf486b80f47137c8c8ae30, 5580656ad96740bca8c6a45b31c3d903; no voters:
I20260808 07:07:04.442291 11910 raft_consensus.cc:2781] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:04.442327 11910 raft_consensus.cc:482] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:04.442364 11910 raft_consensus.cc:3037] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:04.443105 11904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.436473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:50741 (local address 127.9.94.3:43877)
0808 07:07:04.436583 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.436586 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.436593 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:07:04.436620 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.436620 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.436631 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.436685 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:04.437518 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.438338 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.441440 (+ 3102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.442073 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.442149 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.442161 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.442982 (+ 821us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.443028 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 07:07:04.443289 11910 raft_consensus.cc:504] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.443470 11959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.436245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:43877 (local address 127.9.94.1:50741)
0808 07:07:04.436419 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.436430 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.436481 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.436771 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.436773 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.436776 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:04.437354 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.437358 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.438461 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.438462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.441293 (+ 2831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.441297 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.442781 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.442782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.442880 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.442884 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.443221 (+ 337us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.443270 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":66,"threads_started":1}
I20260808 07:07:04.443558 11910 leader_election.cc:288] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [CANDIDATE]: Term 1 election: Requested vote from peers 4c0f715f33bf486b80f47137c8c8ae30 (127.9.94.2:38515), adf54b65e3354539b573d8c5449cf50d (127.9.94.3:43877)
I20260808 07:07:04.443832 11834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9849b3124569486a9b70f59fd08020b3" candidate_uuid: "5580656ad96740bca8c6a45b31c3d903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf54b65e3354539b573d8c5449cf50d" is_pre_election: true
I20260808 07:07:04.443938 11834 raft_consensus.cc:2454] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5580656ad96740bca8c6a45b31c3d903 in term 0.
I20260808 07:07:04.444024 11833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9849b3124569486a9b70f59fd08020b3" candidate_uuid: "5580656ad96740bca8c6a45b31c3d903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf54b65e3354539b573d8c5449cf50d"
I20260808 07:07:04.444150 11833 raft_consensus.cc:3037] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:04.444278 11692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9849b3124569486a9b70f59fd08020b3" candidate_uuid: "5580656ad96740bca8c6a45b31c3d903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c0f715f33bf486b80f47137c8c8ae30"
I20260808 07:07:04.444478 11692 raft_consensus.cc:3037] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:04.445335 11833 raft_consensus.cc:2454] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5580656ad96740bca8c6a45b31c3d903 in term 1.
I20260808 07:07:04.445540 11478 leader_election.cc:302] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5580656ad96740bca8c6a45b31c3d903, adf54b65e3354539b573d8c5449cf50d; no voters:
I20260808 07:07:04.445643 11910 raft_consensus.cc:2781] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:04.445809 11910 raft_consensus.cc:686] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [term 1 LEADER]: Becoming Leader. State: Replica: 5580656ad96740bca8c6a45b31c3d903, State: Running, Role: LEADER
I20260808 07:07:04.445842 11692 raft_consensus.cc:2454] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5580656ad96740bca8c6a45b31c3d903 in term 1.
I20260808 07:07:04.445886 11910 consensus_queue.cc:237] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:04.446774 11386 catalog_manager.cc:5495] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5580656ad96740bca8c6a45b31c3d903 (127.9.94.1). New cstate: current_term: 1 leader_uuid: "5580656ad96740bca8c6a45b31c3d903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } health_report { overall_health: UNKNOWN } } }
W20260808 07:07:04.449685 11883 tablet.cc:2369] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:07:04.457350 11903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.453707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46040 (local address 127.9.94.1:43615)
0808 07:07:04.453751 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.453753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.453786 (+ 33us) server_negotiation.cc:407] Connection header received
0808 07:07:04.453898 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.453899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.453921 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.454004 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:04.454166 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.454931 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.456272 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.456575 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.456667 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.456897 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:04.457072 (+ 175us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:04.457163 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.457223 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.457248 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:07:04.464890 11904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.461272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:57133 (local address 127.9.94.3:43877)
0808 07:07:04.461317 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.461320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.461349 (+ 29us) server_negotiation.cc:407] Connection header received
0808 07:07:04.461417 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.461418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.461429 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.461487 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:04.461670 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.462551 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.463822 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.464170 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.464253 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.464509 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:04.464550 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:04.464604 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.464728 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.464762 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:07:04.465170 11965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.461086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:43877 (local address 127.9.94.1:57133)
0808 07:07:04.461268 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.461290 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.461346 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.461490 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.461491 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.461493 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:07:04.461590 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.461592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.462649 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.462650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.463710 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.463714 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.464282 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.464283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.464366 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.464392 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:07:04.464623 (+ 231us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:07:04.464626 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.465010 (+ 384us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.465070 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":90,"threads_started":1}
I20260808 07:07:04.471397 11692 raft_consensus.cc:1261] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 FOLLOWER]: Refusing update from remote peer 5580656ad96740bca8c6a45b31c3d903: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:04.471704 11910 consensus_queue.cc:1035] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:04.471997 11833 raft_consensus.cc:1261] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Refusing update from remote peer 5580656ad96740bca8c6a45b31c3d903: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:04.472698 11910 consensus_queue.cc:1035] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:04.482648 11888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.479061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:43615 (local address 127.9.94.3:39761)
0808 07:07:04.479142 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:04.479153 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:04.479190 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:04.479479 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:04.479481 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:04.479482 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:07:04.479532 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.479535 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.480555 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.480556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.481547 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:04.481550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.482127 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.482128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:04.482195 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.482200 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:07:04.482416 (+ 216us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:07:04.482417 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 07:07:04.482464 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:07:04.482533 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 07:07:04.483001 11903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:04.479258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:39761 (local address 127.9.94.1:43615)
0808 07:07:04.479314 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:04.479316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:04.479327 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:04.479351 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:04.479352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:04.479363 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:04.479426 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:04.479617 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.480469 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.481641 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:04.481988 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:04.482068 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:04.482298 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:04.482337 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:04.482390 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:04.482891 (+ 501us) server_negotiation.cc:299] Negotiation successful
0808 07:07:04.482918 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
W20260808 07:07:04.483335 11935 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 07:07:06.015167 11386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:06.015309 11386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:06.016628 11386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827: Sending DeleteTablet for 3 replicas of tablet 9849b3124569486a9b70f59fd08020b3
I20260808 07:07:06.016974 11527 tablet_service.cc:1514] Processing DeleteTablet for tablet 9849b3124569486a9b70f59fd08020b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:06 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:46032
I20260808 07:07:06.017024 11814 tablet_service.cc:1514] Processing DeleteTablet for tablet 9849b3124569486a9b70f59fd08020b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:06 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:55596
I20260808 07:07:06.017024 11671 tablet_service.cc:1514] Processing DeleteTablet for tablet 9849b3124569486a9b70f59fd08020b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:06 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:41746
I20260808 07:07:06.017263 11991 tablet_replica.cc:330] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903: stopping tablet replica
I20260808 07:07:06.017306 11992 tablet_replica.cc:330] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d: stopping tablet replica
I20260808 07:07:06.017295 11993 tablet_replica.cc:330] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30: stopping tablet replica
I20260808 07:07:06.017373 11992 raft_consensus.cc:2229] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:06.017406 11993 raft_consensus.cc:2229] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:06.017423 11992 raft_consensus.cc:2258] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:06.017470 11993 raft_consensus.cc:2258] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:06.017649 11991 raft_consensus.cc:2229] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:07:06.017807 11993 ts_tablet_manager.cc:1905] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:06.017853 11992 ts_tablet_manager.cc:1905] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:06.017827 11991 raft_consensus.cc:2258] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:06.018179 11991 ts_tablet_manager.cc:1905] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:06.020115 11993 ts_tablet_manager.cc:1918] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 07:07:06.020203 11993 log.cc:1196] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/9849b3124569486a9b70f59fd08020b3
I20260808 07:07:06.020138 11991 ts_tablet_manager.cc:1918] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 07:07:06.020385 11991 log.cc:1196] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/wal/wals/9849b3124569486a9b70f59fd08020b3
I20260808 07:07:06.020498 11993 ts_tablet_manager.cc:1939] T 9849b3124569486a9b70f59fd08020b3 P 4c0f715f33bf486b80f47137c8c8ae30: Deleting consensus metadata
I20260808 07:07:06.020735 11991 ts_tablet_manager.cc:1939] T 9849b3124569486a9b70f59fd08020b3 P 5580656ad96740bca8c6a45b31c3d903: Deleting consensus metadata
I20260808 07:07:06.021032 11372 catalog_manager.cc:4841] TS 4c0f715f33bf486b80f47137c8c8ae30 (127.9.94.2:38515): tablet 9849b3124569486a9b70f59fd08020b3 (table test-table [id=f4ac9c3edf43475a811cbf045fadc664]) successfully deleted
I20260808 07:07:06.021351 11373 catalog_manager.cc:4841] TS 5580656ad96740bca8c6a45b31c3d903 (127.9.94.1:43615): tablet 9849b3124569486a9b70f59fd08020b3 (table test-table [id=f4ac9c3edf43475a811cbf045fadc664]) successfully deleted
I20260808 07:07:06.022746 11992 ts_tablet_manager.cc:1918] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 07:07:06.022825 11992 log.cc:1196] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/9849b3124569486a9b70f59fd08020b3
I20260808 07:07:06.023036 11992 ts_tablet_manager.cc:1939] T 9849b3124569486a9b70f59fd08020b3 P adf54b65e3354539b573d8c5449cf50d: Deleting consensus metadata
I20260808 07:07:06.023391 11371 catalog_manager.cc:4841] TS adf54b65e3354539b573d8c5449cf50d (127.9.94.3:43877): tablet 9849b3124569486a9b70f59fd08020b3 (table test-table [id=f4ac9c3edf43475a811cbf045fadc664]) successfully deleted
Aug 08 07:07:06 dist-test-slave-77v9 krb5kdc[11342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172826, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 07:07:06 dist-test-slave-77v9 krb5kdc[11342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172826, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:06.055378 12001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:06.038689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36740 (local address 127.9.94.62:43931)
0808 07:07:06.038919 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:06.038921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:06.038932 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:06.039026 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:06.039027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:06.039042 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:06.039125 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:06.039864 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:06.040450 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:06.041320 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:06.041565 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:06.041630 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:06.051596 (+ 9966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:06.051599 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:06.051599 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:06.051609 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:06.053505 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:06.054032 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:06.054033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:06.054033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:06.054107 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:06.054408 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:06.054409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:06.054409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:06.054727 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:06.054931 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:06.055177 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 07:07:06.055270 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":103,"threads_started":1}
I20260808 07:07:06.057838 11386 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36740:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:07:06.058012 11386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:06.059753 11671 tablet_service.cc:1467] Processing CreateTablet for tablet 16b1ff5418c44beca1281f5c9dc32544 (DEFAULT_TABLE table=test-table [id=a9140a5e4af14e34a457c0668991059c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:06.059692 11527 tablet_service.cc:1467] Processing CreateTablet for tablet 16b1ff5418c44beca1281f5c9dc32544 (DEFAULT_TABLE table=test-table [id=a9140a5e4af14e34a457c0668991059c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:06.059862 11814 tablet_service.cc:1467] Processing CreateTablet for tablet 16b1ff5418c44beca1281f5c9dc32544 (DEFAULT_TABLE table=test-table [id=a9140a5e4af14e34a457c0668991059c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:06.060134 11814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16b1ff5418c44beca1281f5c9dc32544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:06.060140 11527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16b1ff5418c44beca1281f5c9dc32544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:06.060148 11671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16b1ff5418c44beca1281f5c9dc32544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:06.061501 12002 tablet_bootstrap.cc:492] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30: Bootstrap starting.
I20260808 07:07:06.061733 12003 tablet_bootstrap.cc:492] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903: Bootstrap starting.
I20260808 07:07:06.061892 12002 tablet_bootstrap.cc:654] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:06.062107 12004 tablet_bootstrap.cc:492] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d: Bootstrap starting.
I20260808 07:07:06.062129 12003 tablet_bootstrap.cc:654] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:06.062546 12004 tablet_bootstrap.cc:654] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:06.062678 12002 tablet_bootstrap.cc:492] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30: No bootstrap required, opened a new log
I20260808 07:07:06.062740 12002 ts_tablet_manager.cc:1397] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:06.062880 12003 tablet_bootstrap.cc:492] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903: No bootstrap required, opened a new log
I20260808 07:07:06.062861 12002 raft_consensus.cc:348] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.062939 12003 ts_tablet_manager.cc:1397] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:06.062964 12002 raft_consensus.cc:374] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:06.062989 12002 raft_consensus.cc:729] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c0f715f33bf486b80f47137c8c8ae30, State: Initialized, Role: FOLLOWER
I20260808 07:07:06.063045 12002 consensus_queue.cc:260] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.063071 12003 raft_consensus.cc:348] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.063156 12003 raft_consensus.cc:374] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:06.063189 12003 raft_consensus.cc:729] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5580656ad96740bca8c6a45b31c3d903, State: Initialized, Role: FOLLOWER
I20260808 07:07:06.063247 12002 ts_tablet_manager.cc:1428] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:07:06.063378 12003 consensus_queue.cc:260] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.063702 12004 tablet_bootstrap.cc:492] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d: No bootstrap required, opened a new log
I20260808 07:07:06.063871 12004 ts_tablet_manager.cc:1397] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:07:06.064452 12004 raft_consensus.cc:348] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.064719 12004 raft_consensus.cc:374] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:06.064771 12004 raft_consensus.cc:729] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf54b65e3354539b573d8c5449cf50d, State: Initialized, Role: FOLLOWER
I20260808 07:07:06.064860 12004 consensus_queue.cc:260] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.064988 12004 ts_tablet_manager.cc:1428] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:06.065004 12003 ts_tablet_manager.cc:1428] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:07:06.070984 12008 raft_consensus.cc:482] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:06.071111 12008 raft_consensus.cc:504] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.071297 12008 leader_election.cc:288] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5580656ad96740bca8c6a45b31c3d903 (127.9.94.1:43615), adf54b65e3354539b573d8c5449cf50d (127.9.94.3:43877)
I20260808 07:07:06.071532 11833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16b1ff5418c44beca1281f5c9dc32544" candidate_uuid: "4c0f715f33bf486b80f47137c8c8ae30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf54b65e3354539b573d8c5449cf50d" is_pre_election: true
I20260808 07:07:06.071532 11547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16b1ff5418c44beca1281f5c9dc32544" candidate_uuid: "4c0f715f33bf486b80f47137c8c8ae30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5580656ad96740bca8c6a45b31c3d903" is_pre_election: true
I20260808 07:07:06.071635 11547 raft_consensus.cc:2454] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c0f715f33bf486b80f47137c8c8ae30 in term 0.
I20260808 07:07:06.071638 11833 raft_consensus.cc:2454] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c0f715f33bf486b80f47137c8c8ae30 in term 0.
I20260808 07:07:06.071893 11622 leader_election.cc:302] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c0f715f33bf486b80f47137c8c8ae30, adf54b65e3354539b573d8c5449cf50d; no voters:
I20260808 07:07:06.072045 12008 raft_consensus.cc:2781] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:06.072105 12008 raft_consensus.cc:482] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:06.072129 12008 raft_consensus.cc:3037] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:06.072923 12008 raft_consensus.cc:504] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.073060 12008 leader_election.cc:288] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [CANDIDATE]: Term 1 election: Requested vote from peers 5580656ad96740bca8c6a45b31c3d903 (127.9.94.1:43615), adf54b65e3354539b573d8c5449cf50d (127.9.94.3:43877)
I20260808 07:07:06.073223 11547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16b1ff5418c44beca1281f5c9dc32544" candidate_uuid: "4c0f715f33bf486b80f47137c8c8ae30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5580656ad96740bca8c6a45b31c3d903"
I20260808 07:07:06.073223 11833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16b1ff5418c44beca1281f5c9dc32544" candidate_uuid: "4c0f715f33bf486b80f47137c8c8ae30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf54b65e3354539b573d8c5449cf50d"
I20260808 07:07:06.073314 11547 raft_consensus.cc:3037] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:06.073336 11833 raft_consensus.cc:3037] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:06.074119 11833 raft_consensus.cc:2454] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c0f715f33bf486b80f47137c8c8ae30 in term 1.
I20260808 07:07:06.074119 11547 raft_consensus.cc:2454] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c0f715f33bf486b80f47137c8c8ae30 in term 1.
I20260808 07:07:06.074352 11622 leader_election.cc:302] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c0f715f33bf486b80f47137c8c8ae30, adf54b65e3354539b573d8c5449cf50d; no voters:
I20260808 07:07:06.074600 12008 raft_consensus.cc:2781] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:06.074764 12008 raft_consensus.cc:686] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 LEADER]: Becoming Leader. State: Replica: 4c0f715f33bf486b80f47137c8c8ae30, State: Running, Role: LEADER
I20260808 07:07:06.074819 12008 consensus_queue.cc:237] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.075377 11388 catalog_manager.cc:5495] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c0f715f33bf486b80f47137c8c8ae30 (127.9.94.2). New cstate: current_term: 1 leader_uuid: "4c0f715f33bf486b80f47137c8c8ae30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } health_report { overall_health: UNKNOWN } } }
I20260808 07:07:06.085990 12014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:06.083168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41768 (local address 127.9.94.2:38515)
0808 07:07:06.083307 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:06.083309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:06.083317 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:07:06.083345 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:06.083345 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:06.083355 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:06.083419 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:06.083576 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:06.084041 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:06.085152 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:06.085534 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:06.085597 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:06.085717 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:06.085746 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:06.085794 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:06.085834 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 07:07:06.085854 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":93,"threads_started":1}
I20260808 07:07:06.089038 11833 raft_consensus.cc:1261] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Refusing update from remote peer 4c0f715f33bf486b80f47137c8c8ae30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:06.089318 12008 consensus_queue.cc:1035] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:06.089375 11547 raft_consensus.cc:1261] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903 [term 1 FOLLOWER]: Refusing update from remote peer 4c0f715f33bf486b80f47137c8c8ae30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:06.089604 12008 consensus_queue.cc:1035] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:06.104671 11386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:06.104893 11386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:06.105755 11386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827: Sending DeleteTablet for 3 replicas of tablet 16b1ff5418c44beca1281f5c9dc32544
I20260808 07:07:06.106094 11671 tablet_service.cc:1514] Processing DeleteTablet for tablet 16b1ff5418c44beca1281f5c9dc32544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:06 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:41746
I20260808 07:07:06.106149 11527 tablet_service.cc:1514] Processing DeleteTablet for tablet 16b1ff5418c44beca1281f5c9dc32544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:06 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:46032
I20260808 07:07:06.106199 11993 tablet_replica.cc:330] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30: stopping tablet replica
I20260808 07:07:06.106199 11814 tablet_service.cc:1514] Processing DeleteTablet for tablet 16b1ff5418c44beca1281f5c9dc32544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:06 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:55596
I20260808 07:07:06.106258 11993 raft_consensus.cc:2229] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:07:06.106316 11991 tablet_replica.cc:330] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903: stopping tablet replica
I20260808 07:07:06.106335 11993 raft_consensus.cc:2258] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:06.106391 11991 raft_consensus.cc:2229] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:06.106464 11991 raft_consensus.cc:2258] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:06.106459 11386 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36740:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 07:07:06.106546 11992 tablet_replica.cc:330] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d: stopping tablet replica
I20260808 07:07:06.106604 11992 raft_consensus.cc:2229] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260808 07:07:06.106613 11386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:06.106644 11992 raft_consensus.cc:2258] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:06.107060 11991 ts_tablet_manager.cc:1905] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:06.107098 11993 ts_tablet_manager.cc:1905] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:06.108975 11993 ts_tablet_manager.cc:1918] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:07:06.109045 11993 log.cc:1196] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/16b1ff5418c44beca1281f5c9dc32544
I20260808 07:07:06.109035 11992 ts_tablet_manager.cc:1905] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:06.109300 11993 ts_tablet_manager.cc:1939] T 16b1ff5418c44beca1281f5c9dc32544 P 4c0f715f33bf486b80f47137c8c8ae30: Deleting consensus metadata
I20260808 07:07:06.109645 11372 catalog_manager.cc:4841] TS 4c0f715f33bf486b80f47137c8c8ae30 (127.9.94.2:38515): tablet 16b1ff5418c44beca1281f5c9dc32544 (table test-table [id=a9140a5e4af14e34a457c0668991059c]) successfully deleted
I20260808 07:07:06.110477 11991 ts_tablet_manager.cc:1918] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:07:06.110553 11991 log.cc:1196] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-0/wal/wals/16b1ff5418c44beca1281f5c9dc32544
I20260808 07:07:06.110783 11991 ts_tablet_manager.cc:1939] T 16b1ff5418c44beca1281f5c9dc32544 P 5580656ad96740bca8c6a45b31c3d903: Deleting consensus metadata
I20260808 07:07:06.110854 11527 tablet_service.cc:1467] Processing CreateTablet for tablet ae5e84fb9eac4f26a1111f0432903da9 (DEFAULT_TABLE table=test-table [id=b6f40869908e4f47b0bedc53207d706e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:06.110980 11671 tablet_service.cc:1467] Processing CreateTablet for tablet ae5e84fb9eac4f26a1111f0432903da9 (DEFAULT_TABLE table=test-table [id=b6f40869908e4f47b0bedc53207d706e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:06.111173 11671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae5e84fb9eac4f26a1111f0432903da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:06.111163 11527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae5e84fb9eac4f26a1111f0432903da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:06.111322 11814 tablet_service.cc:1467] Processing CreateTablet for tablet ae5e84fb9eac4f26a1111f0432903da9 (DEFAULT_TABLE table=test-table [id=b6f40869908e4f47b0bedc53207d706e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:06.111434 11373 catalog_manager.cc:4841] TS 5580656ad96740bca8c6a45b31c3d903 (127.9.94.1:43615): tablet 16b1ff5418c44beca1281f5c9dc32544 (table test-table [id=a9140a5e4af14e34a457c0668991059c]) successfully deleted
I20260808 07:07:06.111511 11992 ts_tablet_manager.cc:1918] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:07:06.111567 11992 log.cc:1196] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/16b1ff5418c44beca1281f5c9dc32544
I20260808 07:07:06.111802 11992 ts_tablet_manager.cc:1939] T 16b1ff5418c44beca1281f5c9dc32544 P adf54b65e3354539b573d8c5449cf50d: Deleting consensus metadata
I20260808 07:07:06.111959 11814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae5e84fb9eac4f26a1111f0432903da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:06.112365 11371 catalog_manager.cc:4841] TS adf54b65e3354539b573d8c5449cf50d (127.9.94.3:43877): tablet 16b1ff5418c44beca1281f5c9dc32544 (table test-table [id=a9140a5e4af14e34a457c0668991059c]) successfully deleted
I20260808 07:07:06.113044 12003 tablet_bootstrap.cc:492] T ae5e84fb9eac4f26a1111f0432903da9 P 5580656ad96740bca8c6a45b31c3d903: Bootstrap starting.
I20260808 07:07:06.113421 12002 tablet_bootstrap.cc:492] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30: Bootstrap starting.
I20260808 07:07:06.113463 12003 tablet_bootstrap.cc:654] T ae5e84fb9eac4f26a1111f0432903da9 P 5580656ad96740bca8c6a45b31c3d903: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:06.113619 12004 tablet_bootstrap.cc:492] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d: Bootstrap starting.
I20260808 07:07:06.113758 12002 tablet_bootstrap.cc:654] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:06.113978 12004 tablet_bootstrap.cc:654] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:06.114090 12003 tablet_bootstrap.cc:492] T ae5e84fb9eac4f26a1111f0432903da9 P 5580656ad96740bca8c6a45b31c3d903: No bootstrap required, opened a new log
I20260808 07:07:06.114126 12003 ts_tablet_manager.cc:1397] T ae5e84fb9eac4f26a1111f0432903da9 P 5580656ad96740bca8c6a45b31c3d903: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:06.114219 12003 raft_consensus.cc:348] T ae5e84fb9eac4f26a1111f0432903da9 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.114316 12003 raft_consensus.cc:374] T ae5e84fb9eac4f26a1111f0432903da9 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:06.114346 12003 raft_consensus.cc:729] T ae5e84fb9eac4f26a1111f0432903da9 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5580656ad96740bca8c6a45b31c3d903, State: Initialized, Role: FOLLOWER
I20260808 07:07:06.114456 12003 consensus_queue.cc:260] T ae5e84fb9eac4f26a1111f0432903da9 P 5580656ad96740bca8c6a45b31c3d903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.114570 12003 ts_tablet_manager.cc:1428] T ae5e84fb9eac4f26a1111f0432903da9 P 5580656ad96740bca8c6a45b31c3d903: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:06.114684 12004 tablet_bootstrap.cc:492] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d: No bootstrap required, opened a new log
I20260808 07:07:06.114734 12004 ts_tablet_manager.cc:1397] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:06.114861 12004 raft_consensus.cc:348] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.114939 12004 raft_consensus.cc:374] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:06.114962 12004 raft_consensus.cc:729] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf54b65e3354539b573d8c5449cf50d, State: Initialized, Role: FOLLOWER
I20260808 07:07:06.115020 12004 consensus_queue.cc:260] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.115134 12004 ts_tablet_manager.cc:1428] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:06.115622 12002 tablet_bootstrap.cc:492] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30: No bootstrap required, opened a new log
I20260808 07:07:06.115691 12002 ts_tablet_manager.cc:1397] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:07:06.115810 12002 raft_consensus.cc:348] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.115890 12002 raft_consensus.cc:374] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:06.115983 12002 raft_consensus.cc:729] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c0f715f33bf486b80f47137c8c8ae30, State: Initialized, Role: FOLLOWER
I20260808 07:07:06.116053 12002 consensus_queue.cc:260] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.116156 12002 ts_tablet_manager.cc:1428] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260808 07:07:06.243588 11739 tablet.cc:2369] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:07:06.273834 12018 raft_consensus.cc:482] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:06.273977 12018 raft_consensus.cc:504] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.274165 12018 leader_election.cc:288] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5580656ad96740bca8c6a45b31c3d903 (127.9.94.1:43615), adf54b65e3354539b573d8c5449cf50d (127.9.94.3:43877)
I20260808 07:07:06.274410 11547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae5e84fb9eac4f26a1111f0432903da9" candidate_uuid: "4c0f715f33bf486b80f47137c8c8ae30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5580656ad96740bca8c6a45b31c3d903" is_pre_election: true
I20260808 07:07:06.274524 11547 raft_consensus.cc:2454] T ae5e84fb9eac4f26a1111f0432903da9 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c0f715f33bf486b80f47137c8c8ae30 in term 0.
I20260808 07:07:06.274459 11833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae5e84fb9eac4f26a1111f0432903da9" candidate_uuid: "4c0f715f33bf486b80f47137c8c8ae30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf54b65e3354539b573d8c5449cf50d" is_pre_election: true
I20260808 07:07:06.274564 11833 raft_consensus.cc:2454] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c0f715f33bf486b80f47137c8c8ae30 in term 0.
I20260808 07:07:06.274689 11624 leader_election.cc:302] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c0f715f33bf486b80f47137c8c8ae30, 5580656ad96740bca8c6a45b31c3d903; no voters:
I20260808 07:07:06.274814 12018 raft_consensus.cc:2781] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:06.274869 12018 raft_consensus.cc:482] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:06.274935 12018 raft_consensus.cc:3037] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:06.275647 12018 raft_consensus.cc:504] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.275846 12018 leader_election.cc:288] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [CANDIDATE]: Term 1 election: Requested vote from peers 5580656ad96740bca8c6a45b31c3d903 (127.9.94.1:43615), adf54b65e3354539b573d8c5449cf50d (127.9.94.3:43877)
I20260808 07:07:06.275933 11833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae5e84fb9eac4f26a1111f0432903da9" candidate_uuid: "4c0f715f33bf486b80f47137c8c8ae30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf54b65e3354539b573d8c5449cf50d"
I20260808 07:07:06.275945 11547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae5e84fb9eac4f26a1111f0432903da9" candidate_uuid: "4c0f715f33bf486b80f47137c8c8ae30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5580656ad96740bca8c6a45b31c3d903"
I20260808 07:07:06.276021 11833 raft_consensus.cc:3037] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:06.276037 11547 raft_consensus.cc:3037] T ae5e84fb9eac4f26a1111f0432903da9 P 5580656ad96740bca8c6a45b31c3d903 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:06.276639 11547 raft_consensus.cc:2454] T ae5e84fb9eac4f26a1111f0432903da9 P 5580656ad96740bca8c6a45b31c3d903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c0f715f33bf486b80f47137c8c8ae30 in term 1.
I20260808 07:07:06.276883 11624 leader_election.cc:302] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c0f715f33bf486b80f47137c8c8ae30, 5580656ad96740bca8c6a45b31c3d903; no voters:
I20260808 07:07:06.276893 11833 raft_consensus.cc:2454] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c0f715f33bf486b80f47137c8c8ae30 in term 1.
I20260808 07:07:06.277041 12018 raft_consensus.cc:2781] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:06.277097 12018 raft_consensus.cc:686] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 LEADER]: Becoming Leader. State: Replica: 4c0f715f33bf486b80f47137c8c8ae30, State: Running, Role: LEADER
I20260808 07:07:06.277148 12018 consensus_queue.cc:237] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } }
I20260808 07:07:06.277974 11388 catalog_manager.cc:5495] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c0f715f33bf486b80f47137c8c8ae30 (127.9.94.2). New cstate: current_term: 1 leader_uuid: "4c0f715f33bf486b80f47137c8c8ae30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c0f715f33bf486b80f47137c8c8ae30" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 38515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 } health_report { overall_health: UNKNOWN } } }
I20260808 07:07:06.304389 11833 raft_consensus.cc:1261] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Refusing update from remote peer 4c0f715f33bf486b80f47137c8c8ae30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:06.304386 11547 raft_consensus.cc:1261] T ae5e84fb9eac4f26a1111f0432903da9 P 5580656ad96740bca8c6a45b31c3d903 [term 1 FOLLOWER]: Refusing update from remote peer 4c0f715f33bf486b80f47137c8c8ae30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:06.304647 12018 consensus_queue.cc:1035] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf54b65e3354539b573d8c5449cf50d" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 43877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:06.304781 12008 consensus_queue.cc:1035] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5580656ad96740bca8c6a45b31c3d903" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 07:07:06.310137 11973 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 07:07:07.834735 11386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:07.834947 11386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:07.836377 11386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e7d970e3859345dca90a885c8808f827: Sending DeleteTablet for 3 replicas of tablet ae5e84fb9eac4f26a1111f0432903da9
I20260808 07:07:07.836750 11671 tablet_service.cc:1514] Processing DeleteTablet for tablet ae5e84fb9eac4f26a1111f0432903da9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:07 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:41746
I20260808 07:07:07.836850 11814 tablet_service.cc:1514] Processing DeleteTablet for tablet ae5e84fb9eac4f26a1111f0432903da9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:07 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:55596
I20260808 07:07:07.836846 11527 tablet_service.cc:1514] Processing DeleteTablet for tablet ae5e84fb9eac4f26a1111f0432903da9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:07 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:46032
I20260808 07:07:07.837136 12048 tablet_replica.cc:330] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30: stopping tablet replica
I20260808 07:07:07.837121 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 11462
I20260808 07:07:07.837193 12048 raft_consensus.cc:2229] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:07:07.840121 12048 raft_consensus.cc:2258] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:07.840461 12048 ts_tablet_manager.cc:1905] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:07.841212 12049 tablet_replica.cc:330] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d: stopping tablet replica
I20260808 07:07:07.841312 12049 raft_consensus.cc:2229] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:07.841375 12049 raft_consensus.cc:2258] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:07.842679 12048 ts_tablet_manager.cc:1918] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 07:07:07.842758 12048 log.cc:1196] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/ae5e84fb9eac4f26a1111f0432903da9
I20260808 07:07:07.842993 12048 ts_tablet_manager.cc:1939] T ae5e84fb9eac4f26a1111f0432903da9 P 4c0f715f33bf486b80f47137c8c8ae30: Deleting consensus metadata
I20260808 07:07:07.843659 11372 catalog_manager.cc:4841] TS 4c0f715f33bf486b80f47137c8c8ae30 (127.9.94.2:38515): tablet ae5e84fb9eac4f26a1111f0432903da9 (table test-table [id=b6f40869908e4f47b0bedc53207d706e]) successfully deleted
I20260808 07:07:07.845296 12049 ts_tablet_manager.cc:1905] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 07:07:07.846040 11373 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:43615 (error 108)
I20260808 07:07:07.846369 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 11606
I20260808 07:07:07.847898 12052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:07.847545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:43615 (local address 127.0.0.1:46056)
0808 07:07:07.847760 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:07.847836 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":127,"threads_started":1}
I20260808 07:07:07.848260 12049 ts_tablet_manager.cc:1918] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 07:07:07.848345 12049 log.cc:1196] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/ae5e84fb9eac4f26a1111f0432903da9
W20260808 07:07:07.848357 11373 catalog_manager.cc:4584] TS 5580656ad96740bca8c6a45b31c3d903 (127.9.94.1:43615): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ae5e84fb9eac4f26a1111f0432903da9: Network error: Client connection negotiation failed: client connection to 127.9.94.1:43615: connect: Connection refused (error 111)
I20260808 07:07:07.848590 12049 ts_tablet_manager.cc:1939] T ae5e84fb9eac4f26a1111f0432903da9 P adf54b65e3354539b573d8c5449cf50d: Deleting consensus metadata
I20260808 07:07:07.853508 11371 catalog_manager.cc:4841] TS adf54b65e3354539b573d8c5449cf50d (127.9.94.3:43877): tablet ae5e84fb9eac4f26a1111f0432903da9 (table test-table [id=b6f40869908e4f47b0bedc53207d706e]) successfully deleted
I20260808 07:07:07.854748 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 11747
I20260808 07:07:07.862700 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 11355
2026-08-08T07:07:07Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5866 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:07:07 dist-test-slave-77v9 krb5kdc[12055](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:07:07 dist-test-slave-77v9 krb5kdc[12055](info): set up 2 sockets
Aug 08 07:07:07 dist-test-slave-77v9 krb5kdc[12055](info): commencing operation
krb5kdc: starting...
W20260808 07:07:09.041801 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:07:09 dist-test-slave-77v9 krb5kdc[12055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:07:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:07:09.197482 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36649
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:36649
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:09.295431 12068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:09.295678 12068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:09.295704 12068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:09.296986 12068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:09.297041 12068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:09.297056 12068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:09.297070 12068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:09.297082 12068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:09.298854 12068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:36649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:09.299176 12068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:09.299445 12068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:09.304642 12077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:09.304663 12075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:09.304651 12074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:09.305016 12068 server_base.cc:1034] running on GCE node
I20260808 07:07:09.305289 12068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:09.305624 12068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:09.306789 12068 hybrid_clock.cc:648] HybridClock initialized: now 1786172829306786 us; error 68 us; skew 500 ppm
Aug 08 07:07:09 dist-test-slave-77v9 krb5kdc[12055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172829, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:09.309754 12068 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:07:09.310314 12068 webserver.cc:460] Webserver started at http://127.9.94.62:41225/ using document root <none> and password file <none>
I20260808 07:07:09.310550 12068 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:09.310609 12068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:09.310714 12068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:09.311874 12068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "79a210a3887c4624b5bad1ccc7aa9ae9"
format_stamp: "Formatted at 2026-08-08 07:07:09 on dist-test-slave-77v9"
server_key: "c0ceccec8c672caf49074d7df4c4c619"
server_key_iv: "ffcd5f5f723697de6914c62bdf7b4dd6"
server_key_version: "encryptionkey@0"
I20260808 07:07:09.312225 12068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "79a210a3887c4624b5bad1ccc7aa9ae9"
format_stamp: "Formatted at 2026-08-08 07:07:09 on dist-test-slave-77v9"
server_key: "c0ceccec8c672caf49074d7df4c4c619"
server_key_iv: "ffcd5f5f723697de6914c62bdf7b4dd6"
server_key_version: "encryptionkey@0"
I20260808 07:07:09.313912 12068 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260808 07:07:09.315253 12084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:09.315737 12068 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:09.315935 12068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "79a210a3887c4624b5bad1ccc7aa9ae9"
format_stamp: "Formatted at 2026-08-08 07:07:09 on dist-test-slave-77v9"
server_key: "c0ceccec8c672caf49074d7df4c4c619"
server_key_iv: "ffcd5f5f723697de6914c62bdf7b4dd6"
server_key_version: "encryptionkey@0"
I20260808 07:07:09.316033 12068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:09.326295 12068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:09.328686 12068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:09.328913 12068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:09.334090 12068 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:36649
I20260808 07:07:09.334169 12136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:36649 every 8 connection(s)
I20260808 07:07:09.334961 12068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:09.335937 12137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:09.338666 12137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9: Bootstrap starting.
I20260808 07:07:09.339248 12137 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:09.339498 12137 log.cc:824] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:09.340274 12137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9: No bootstrap required, opened a new log
I20260808 07:07:09.342017 12137 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79a210a3887c4624b5bad1ccc7aa9ae9" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36649 } }
I20260808 07:07:09.342168 12137 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:09.342191 12137 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79a210a3887c4624b5bad1ccc7aa9ae9, State: Initialized, Role: FOLLOWER
I20260808 07:07:09.342370 12137 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79a210a3887c4624b5bad1ccc7aa9ae9" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36649 } }
I20260808 07:07:09.342468 12137 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:09.342494 12137 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:09.342523 12137 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:09.343050 12137 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79a210a3887c4624b5bad1ccc7aa9ae9" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36649 } }
I20260808 07:07:09.343140 12137 leader_election.cc:302] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79a210a3887c4624b5bad1ccc7aa9ae9; no voters:
I20260808 07:07:09.343273 12137 leader_election.cc:288] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:09.343464 12140 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:09.343559 12137 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:09.343973 12140 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [term 1 LEADER]: Becoming Leader. State: Replica: 79a210a3887c4624b5bad1ccc7aa9ae9, State: Running, Role: LEADER
I20260808 07:07:09.344156 12140 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79a210a3887c4624b5bad1ccc7aa9ae9" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36649 } }
I20260808 07:07:09.344831 12141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79a210a3887c4624b5bad1ccc7aa9ae9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79a210a3887c4624b5bad1ccc7aa9ae9" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36649 } } }
I20260808 07:07:09.344897 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 12068
I20260808 07:07:09.344940 12141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:09.345005 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:09.345213 9592 external_mini_cluster.cc:1428] Setting key eae4e6c6a64d0685632d6757deeeec33
W20260808 07:07:09.345479 12156 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 07:07:09.345130 12142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79a210a3887c4624b5bad1ccc7aa9ae9. Latest consensus state: current_term: 1 leader_uuid: "79a210a3887c4624b5bad1ccc7aa9ae9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79a210a3887c4624b5bad1ccc7aa9ae9" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36649 } } }
W20260808 07:07:09.345592 12156 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:07:09.345638 12142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:09.345774 12157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:09.346231 12157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:09.348141 12157 catalog_manager.cc:1347] Generated new cluster ID: f7edfe2658fb4cf4bacc5f53be91db40
I20260808 07:07:09.348198 12157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:09.354125 12157 catalog_manager.cc:1370] Generated new certificate authority record
Aug 08 07:07:09 dist-test-slave-77v9 krb5kdc[12055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:09.354835 12157 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:09.358695 12161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:09.345978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38326 (local address 127.9.94.62:36649)
0808 07:07:09.346165 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:09.346173 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:09.347087 (+ 914us) server_negotiation.cc:407] Connection header received
0808 07:07:09.347238 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:09.347246 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:09.347323 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:09.347502 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:09.349200 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:09.350241 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:09.351072 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:09.352107 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:09.352341 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:09.355201 (+ 2860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:09.355206 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:09.355206 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:09.355220 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:09.357086 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:09.357479 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:09.357483 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:09.357483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:09.357581 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:09.357790 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:09.357791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:09.357791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:09.358032 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:09.358218 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:09.358290 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 07:07:09.358464 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":81,"threads_started":1}
I20260808 07:07:09.362025 12157 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79a210a3887c4624b5bad1ccc7aa9ae9: Generated new TSK 0
I20260808 07:07:09.362265 12157 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:07:09.401526 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36649
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:09.519227 12165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:09.519496 12165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:09.519546 12165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:09.521165 12165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:09.521240 12165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:09.521293 12165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:09.523056 12165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:09.523387 12165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:09.523720 12165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:07:09.530534 12165 server_base.cc:1034] running on GCE node
W20260808 07:07:09.530478 12171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:09.530496 12170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:09.530561 12173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:09.531030 12165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:09.531311 12165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:09.532471 12165 hybrid_clock.cc:648] HybridClock initialized: now 1786172829532459 us; error 32 us; skew 500 ppm
Aug 08 07:07:09 dist-test-slave-77v9 krb5kdc[12055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172829, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:09.535392 12165 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:07:09.535908 12165 webserver.cc:460] Webserver started at http://127.9.94.1:43023/ using document root <none> and password file <none>
I20260808 07:07:09.536190 12165 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:09.536264 12165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:09.536435 12165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:09.537691 12165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "c5661ceb6e0c40a0b460a5ceaa7139f6"
format_stamp: "Formatted at 2026-08-08 07:07:09 on dist-test-slave-77v9"
server_key: "4bb43010ce0a4044b9a159579c1743c2"
server_key_iv: "701a8478ff20d1225efbeb2376c1f89c"
server_key_version: "encryptionkey@0"
I20260808 07:07:09.538111 12165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "c5661ceb6e0c40a0b460a5ceaa7139f6"
format_stamp: "Formatted at 2026-08-08 07:07:09 on dist-test-slave-77v9"
server_key: "4bb43010ce0a4044b9a159579c1743c2"
server_key_iv: "701a8478ff20d1225efbeb2376c1f89c"
server_key_version: "encryptionkey@0"
I20260808 07:07:09.539776 12165 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:07:09.540723 12180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:09.540990 12165 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:09.541100 12165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "c5661ceb6e0c40a0b460a5ceaa7139f6"
format_stamp: "Formatted at 2026-08-08 07:07:09 on dist-test-slave-77v9"
server_key: "4bb43010ce0a4044b9a159579c1743c2"
server_key_iv: "701a8478ff20d1225efbeb2376c1f89c"
server_key_version: "encryptionkey@0"
I20260808 07:07:09.541175 12165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:09.558898 12165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:09.561457 12165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:09.561643 12165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:09.561916 12165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:09.562278 12165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:09.562335 12165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:09.562381 12165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:09.562430 12165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:09.569044 12165 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:45189
I20260808 07:07:09.569108 12294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:45189 every 8 connection(s)
I20260808 07:07:09.569492 12165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:07:09 dist-test-slave-77v9 krb5kdc[12055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172829, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:09.579272 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 12165
I20260808 07:07:09.579402 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:09.579620 9592 external_mini_cluster.cc:1428] Setting key 619e1a3ae4206a6e938b737db63d69e8
I20260808 07:07:09.579960 12161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:09.570374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:33163 (local address 127.9.94.62:36649)
0808 07:07:09.570456 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:09.570459 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:09.570657 (+ 198us) server_negotiation.cc:407] Connection header received
0808 07:07:09.571165 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:09.571166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:09.571177 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:09.571232 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:09.572230 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:09.572795 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:09.573941 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:09.574165 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:09.574228 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:09.576559 (+ 2331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:09.576561 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:09.576561 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:09.576568 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:09.578112 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:09.578520 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:09.578521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:09.578522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:09.578584 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:09.578937 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:09.578943 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:09.578944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:09.579066 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:09.579131 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:09.579618 (+ 487us) server_negotiation.cc:299] Negotiation successful
0808 07:07:09.579719 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 07:07:09.580042 12298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:09.570312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36649 (local address 127.9.94.1:33163)
0808 07:07:09.570532 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:09.570571 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:09.571077 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:09.571299 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:09.571302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:09.571923 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:09.572124 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:09.572129 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:09.572955 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:09.572956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:09.573841 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:09.573844 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:09.574273 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:09.574274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:09.574399 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:09.574953 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:09.574961 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:09.576455 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:09.578194 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:09.578201 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:09.578203 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:09.578438 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:09.578671 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:09.578672 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:09.578673 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:09.578795 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:09.579158 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:09.579166 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:09.579403 (+ 237us) client_negotiation.cc:769] Sending connection context
0808 07:07:09.579545 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 07:07:09.579758 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":130,"threads_started":1}
I20260808 07:07:09.580551 12295 heartbeater.cc:347] Connected to a master server at 127.9.94.62:36649
I20260808 07:07:09.580643 12295 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:09.580927 12295 heartbeater.cc:511] Master 127.9.94.62:36649 requested a full tablet report, sending...
I20260808 07:07:09.581506 12101 ts_manager.cc:194] Registered new tserver with Master: c5661ceb6e0c40a0b460a5ceaa7139f6 (127.9.94.1:45189)
I20260808 07:07:09.582247 12101 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:33163
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:07:09.613521 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36649
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:09.701256 12302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:09.701488 12302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:09.701531 12302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:09.702801 12302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:09.702878 12302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:09.702926 12302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:09.704433 12302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:09.704723 12302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:09.704981 12302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:09.710901 12310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:09.711054 12308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:09.710947 12307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:09.711380 12302 server_base.cc:1034] running on GCE node
I20260808 07:07:09.711650 12302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:09.711931 12302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:09.713105 12302 hybrid_clock.cc:648] HybridClock initialized: now 1786172829713092 us; error 34 us; skew 500 ppm
Aug 08 07:07:09 dist-test-slave-77v9 krb5kdc[12055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172829, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:09.716418 12302 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:07:09.717679 12302 webserver.cc:460] Webserver started at http://127.9.94.2:34443/ using document root <none> and password file <none>
I20260808 07:07:09.718066 12302 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:09.718159 12302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:09.718353 12302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:09.719769 12302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "f8c04a9bd0794024a61e3ac4038ec983"
format_stamp: "Formatted at 2026-08-08 07:07:09 on dist-test-slave-77v9"
server_key: "1b7301007b0681334885e111e5eb47ac"
server_key_iv: "aa9904263e3676832f5c35bcb46841a5"
server_key_version: "encryptionkey@0"
I20260808 07:07:09.720371 12302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "f8c04a9bd0794024a61e3ac4038ec983"
format_stamp: "Formatted at 2026-08-08 07:07:09 on dist-test-slave-77v9"
server_key: "1b7301007b0681334885e111e5eb47ac"
server_key_iv: "aa9904263e3676832f5c35bcb46841a5"
server_key_version: "encryptionkey@0"
I20260808 07:07:09.722512 12302 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.003s
I20260808 07:07:09.723845 12317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:09.724120 12302 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:09.724241 12302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "f8c04a9bd0794024a61e3ac4038ec983"
format_stamp: "Formatted at 2026-08-08 07:07:09 on dist-test-slave-77v9"
server_key: "1b7301007b0681334885e111e5eb47ac"
server_key_iv: "aa9904263e3676832f5c35bcb46841a5"
server_key_version: "encryptionkey@0"
I20260808 07:07:09.724339 12302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:09.741537 12302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:09.744400 12302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:09.744571 12302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:09.744952 12302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:09.745299 12302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:09.745337 12302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:09.745360 12302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:09.745373 12302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:09.752408 12302 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:42061
I20260808 07:07:09.752457 12432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:42061 every 8 connection(s)
I20260808 07:07:09.752877 12302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:07:09 dist-test-slave-77v9 krb5kdc[12055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172829, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:09.760975 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 12302
I20260808 07:07:09.761104 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:07:09.761346 9592 external_mini_cluster.cc:1428] Setting key 31592b2a512cab1962afcb3bcfc16d86
I20260808 07:07:09.764850 12161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:09.754065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:59779 (local address 127.9.94.62:36649)
0808 07:07:09.754149 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:09.754152 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:09.754554 (+ 402us) server_negotiation.cc:407] Connection header received
0808 07:07:09.755126 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:09.755128 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:09.755139 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:09.755206 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:09.756283 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:09.757059 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:09.758272 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:09.758468 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:09.758543 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:09.761281 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:09.761283 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:09.761283 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:09.761292 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:09.763242 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:09.763730 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:09.763732 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:09.763733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:09.763796 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:09.764114 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:09.764115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:09.764116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:09.764240 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:09.764316 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:09.764622 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 07:07:09.764712 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 07:07:09.765115 12435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:09.754038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36649 (local address 127.9.94.2:59779)
0808 07:07:09.754295 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:09.754417 (+ 122us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:09.754990 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:09.755263 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:09.755267 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:09.755941 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:09.756172 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:09.756177 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:09.757189 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:09.757190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:09.758166 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:09.758169 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:09.758585 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:09.758585 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:09.758728 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:09.759322 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:09.759333 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:09.761160 (+ 1827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:09.763375 (+ 2215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:09.763384 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:09.763387 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:09.763647 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:09.763898 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:09.763899 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:09.763899 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:09.764033 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:09.764307 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:09.764314 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:09.764484 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 07:07:09.764591 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 07:07:09.764766 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":108,"threads_started":1}
I20260808 07:07:09.765628 12433 heartbeater.cc:347] Connected to a master server at 127.9.94.62:36649
I20260808 07:07:09.765740 12433 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:09.765933 12433 heartbeater.cc:511] Master 127.9.94.62:36649 requested a full tablet report, sending...
I20260808 07:07:09.766345 12101 ts_manager.cc:194] Registered new tserver with Master: f8c04a9bd0794024a61e3ac4038ec983 (127.9.94.2:42061)
I20260808 07:07:09.766927 12101 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:59779
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:07:09.792791 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36649
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:09.887981 12440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:09.888252 12440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:09.888294 12440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:09.889823 12440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:09.889919 12440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:09.889974 12440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:09.891788 12440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:09.892100 12440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:09.892372 12440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:09.897740 12445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:09.897773 12440 server_base.cc:1034] running on GCE node
W20260808 07:07:09.897732 12446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:09.897707 12448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:09.898332 12440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:09.898629 12440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:09.899809 12440 hybrid_clock.cc:648] HybridClock initialized: now 1786172829899795 us; error 40 us; skew 500 ppm
Aug 08 07:07:09 dist-test-slave-77v9 krb5kdc[12055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172829, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:09.902997 12440 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:07:09.903503 12440 webserver.cc:460] Webserver started at http://127.9.94.3:43925/ using document root <none> and password file <none>
I20260808 07:07:09.903759 12440 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:09.903836 12440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:09.903985 12440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:09.905647 12440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "f322b34ff20f468ba38a68c3544d8027"
format_stamp: "Formatted at 2026-08-08 07:07:09 on dist-test-slave-77v9"
server_key: "cc266b1e07b01c124aa41976140a5b0d"
server_key_iv: "7be28f7bf5b39bfea01d412710476d7d"
server_key_version: "encryptionkey@0"
I20260808 07:07:09.906389 12440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "f322b34ff20f468ba38a68c3544d8027"
format_stamp: "Formatted at 2026-08-08 07:07:09 on dist-test-slave-77v9"
server_key: "cc266b1e07b01c124aa41976140a5b0d"
server_key_iv: "7be28f7bf5b39bfea01d412710476d7d"
server_key_version: "encryptionkey@0"
I20260808 07:07:09.908305 12440 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:07:09.909288 12455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:09.909464 12440 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:07:09.909585 12440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "f322b34ff20f468ba38a68c3544d8027"
format_stamp: "Formatted at 2026-08-08 07:07:09 on dist-test-slave-77v9"
server_key: "cc266b1e07b01c124aa41976140a5b0d"
server_key_iv: "7be28f7bf5b39bfea01d412710476d7d"
server_key_version: "encryptionkey@0"
I20260808 07:07:09.909682 12440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:09.926760 12440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:09.929678 12440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:09.929821 12440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:09.930059 12440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:09.930430 12440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:09.930475 12440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:09.930519 12440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:09.930554 12440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:09.937858 12440 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:38315
I20260808 07:07:09.937939 12573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:38315 every 8 connection(s)
I20260808 07:07:09.938315 12440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:07:09.939842 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 12440
I20260808 07:07:09.939922 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:07:09.940109 9592 external_mini_cluster.cc:1428] Setting key e60c41342d9a3638608e335c3e207127
Aug 08 07:07:09 dist-test-slave-77v9 krb5kdc[12055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172829, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:09.949364 12161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:09.939262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:48727 (local address 127.9.94.62:36649)
0808 07:07:09.939357 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:09.939359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:09.939559 (+ 200us) server_negotiation.cc:407] Connection header received
0808 07:07:09.940129 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:09.940130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:09.940144 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:09.940207 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:09.941286 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:09.941806 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:09.942803 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:09.943034 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:09.943215 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:09.946160 (+ 2945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:09.946162 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:09.946163 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:09.946171 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:09.947754 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:09.948228 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:09.948229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:09.948229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:09.948293 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:09.948573 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:09.948574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:09.948574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:09.948709 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:09.948784 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:09.949147 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 07:07:09.949246 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 07:07:09.949594 12576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:09.939197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36649 (local address 127.9.94.3:48727)
0808 07:07:09.939426 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:09.939476 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:09.940025 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:09.940305 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:09.940308 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:09.940979 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:09.941183 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:09.941187 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:09.941907 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:09.941908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:09.942703 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:09.942705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:09.943214 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:09.943218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:09.943396 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:09.944176 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:09.944188 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:09.946032 (+ 1844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:09.947863 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:09.947872 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:09.947874 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:09.948130 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:09.948367 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:09.948368 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:09.948369 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:09.948491 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:09.948791 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:09.948798 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:09.948996 (+ 198us) client_negotiation.cc:769] Sending connection context
0808 07:07:09.949119 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 07:07:09.949304 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":97,"threads_started":1}
I20260808 07:07:09.950675 12574 heartbeater.cc:347] Connected to a master server at 127.9.94.62:36649
I20260808 07:07:09.950793 12574 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:09.951022 12574 heartbeater.cc:511] Master 127.9.94.62:36649 requested a full tablet report, sending...
I20260808 07:07:09.951737 12100 ts_manager.cc:194] Registered new tserver with Master: f322b34ff20f468ba38a68c3544d8027 (127.9.94.3:38315)
I20260808 07:07:09.952348 12100 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:48727
I20260808 07:07:09.952448 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 07:07:09.967732 12161 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:09.966643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38332 (local address 127.9.94.62:36649)
0808 07:07:09.966779 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:09.966781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:09.966867 (+ 86us) server_negotiation.cc:407] Connection header received
0808 07:07:09.966967 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:09.966968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:09.966984 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:09.967047 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:09.967633 (+ 586us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38332: BlockingRecv error: recv got EOF from 127.0.0.1:38332 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 07:07:09.968591 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 12165
I20260808 07:07:09.974730 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 12302
I20260808 07:07:09.980598 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 12440
I20260808 07:07:09.985988 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 12068
2026-08-08T07:07:09Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2120 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:07:10 dist-test-slave-77v9 krb5kdc[12586](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:07:10 dist-test-slave-77v9 krb5kdc[12586](info): set up 2 sockets
Aug 08 07:07:10 dist-test-slave-77v9 krb5kdc[12586](info): commencing operation
krb5kdc: starting...
W20260808 07:07:11.100000 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:07:11 dist-test-slave-77v9 krb5kdc[12586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:07:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:07:11.241348 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:44737
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:33287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:44737
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:11.328512 12599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:11.328812 12599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:11.328881 12599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:11.330212 12599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:11.330303 12599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:11.330335 12599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:11.330384 12599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:11.330403 12599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:11.332295 12599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:33287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:44737
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:44737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:11.332607 12599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:11.332914 12599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:11.338088 12604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:11.338074 12608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:11.338313 12599 server_base.cc:1034] running on GCE node
W20260808 07:07:11.338080 12605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:11.338737 12599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:11.339015 12599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:11.340167 12599 hybrid_clock.cc:648] HybridClock initialized: now 1786172831340132 us; error 52 us; skew 500 ppm
Aug 08 07:07:11 dist-test-slave-77v9 krb5kdc[12586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172831, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:11.346480 12599 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:07:11.347127 12599 webserver.cc:460] Webserver started at http://127.9.94.62:45133/ using document root <none> and password file <none>
I20260808 07:07:11.347815 12599 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:11.347915 12599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:11.348161 12599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:11.349412 12599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "d04caca7a59c4e1ca79390e9a424e254"
format_stamp: "Formatted at 2026-08-08 07:07:11 on dist-test-slave-77v9"
server_key: "26aabf53d6eb26dc1dd800706854a5fe"
server_key_iv: "206c9340a5312f715948a926b3b2fe01"
server_key_version: "encryptionkey@0"
I20260808 07:07:11.349797 12599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "d04caca7a59c4e1ca79390e9a424e254"
format_stamp: "Formatted at 2026-08-08 07:07:11 on dist-test-slave-77v9"
server_key: "26aabf53d6eb26dc1dd800706854a5fe"
server_key_iv: "206c9340a5312f715948a926b3b2fe01"
server_key_version: "encryptionkey@0"
I20260808 07:07:11.351256 12599 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:07:11.352154 12616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:11.352413 12599 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:11.352532 12599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "d04caca7a59c4e1ca79390e9a424e254"
format_stamp: "Formatted at 2026-08-08 07:07:11 on dist-test-slave-77v9"
server_key: "26aabf53d6eb26dc1dd800706854a5fe"
server_key_iv: "206c9340a5312f715948a926b3b2fe01"
server_key_version: "encryptionkey@0"
I20260808 07:07:11.352612 12599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:11.366999 12599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:11.369639 12599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:11.369825 12599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:11.374198 12599 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:44737
I20260808 07:07:11.374270 12668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:44737 every 8 connection(s)
I20260808 07:07:11.374660 12599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:11.375638 12669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:11.377735 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 12599
I20260808 07:07:11.377847 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:11.378028 9592 external_mini_cluster.cc:1428] Setting key 0c809579fcc10cf637f22a5a427e8fd4
I20260808 07:07:11.378338 12669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254: Bootstrap starting.
I20260808 07:07:11.379012 12669 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:11.379314 12669 log.cc:824] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:11.379985 12669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254: No bootstrap required, opened a new log
I20260808 07:07:11.381830 12669 raft_consensus.cc:348] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d04caca7a59c4e1ca79390e9a424e254" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 44737 } }
I20260808 07:07:11.381999 12669 raft_consensus.cc:374] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:11.382072 12669 raft_consensus.cc:729] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04caca7a59c4e1ca79390e9a424e254, State: Initialized, Role: FOLLOWER
I20260808 07:07:11.382233 12669 consensus_queue.cc:260] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d04caca7a59c4e1ca79390e9a424e254" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 44737 } }
I20260808 07:07:11.382323 12669 raft_consensus.cc:388] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:11.382370 12669 raft_consensus.cc:482] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:11.382419 12669 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:11.382962 12669 raft_consensus.cc:504] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d04caca7a59c4e1ca79390e9a424e254" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 44737 } }
I20260808 07:07:11.383080 12669 leader_election.cc:302] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d04caca7a59c4e1ca79390e9a424e254; no voters:
I20260808 07:07:11.383256 12669 leader_election.cc:288] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:11.383306 12674 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:11.383489 12674 raft_consensus.cc:686] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [term 1 LEADER]: Becoming Leader. State: Replica: d04caca7a59c4e1ca79390e9a424e254, State: Running, Role: LEADER
I20260808 07:07:11.383567 12669 sys_catalog.cc:564] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:11.383635 12674 consensus_queue.cc:237] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d04caca7a59c4e1ca79390e9a424e254" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 44737 } }
I20260808 07:07:11.384074 12676 sys_catalog.cc:455] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d04caca7a59c4e1ca79390e9a424e254" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d04caca7a59c4e1ca79390e9a424e254" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 44737 } } }
I20260808 07:07:11.384168 12676 sys_catalog.cc:458] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:11.384060 12674 sys_catalog.cc:455] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d04caca7a59c4e1ca79390e9a424e254. Latest consensus state: current_term: 1 leader_uuid: "d04caca7a59c4e1ca79390e9a424e254" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d04caca7a59c4e1ca79390e9a424e254" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 44737 } } }
I20260808 07:07:11.384240 12674 sys_catalog.cc:458] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:11.384490 12681 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:11.385079 12681 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 07:07:11 dist-test-slave-77v9 krb5kdc[12586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:11.387216 12681 catalog_manager.cc:1347] Generated new cluster ID: ae06a52ac4f24a4fa334f5d4abd41aa2
I20260808 07:07:11.387270 12681 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:11.389737 12672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:11.378548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48142 (local address 127.9.94.62:44737)
0808 07:07:11.378759 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:11.378768 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:11.378807 (+ 39us) server_negotiation.cc:407] Connection header received
0808 07:07:11.379315 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:11.379321 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:11.379393 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:11.379556 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:11.380293 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:11.381223 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:11.382002 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:11.382574 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:11.382708 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:11.385833 (+ 3125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:11.385837 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:11.385837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:11.385850 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:11.387988 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:11.388440 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:11.388442 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:11.388443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:11.388548 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:11.388769 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:11.388770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:11.388771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:11.389107 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:11.389284 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:11.389381 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 07:07:11.389517 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":92,"threads_started":1}
I20260808 07:07:11.390793 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:07:11.395530 12681 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:11.396128 12681 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:11.399374 12681 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d04caca7a59c4e1ca79390e9a424e254: Generated new TSK 0
I20260808 07:07:11.399569 12681 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:07:11.412729 12672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:11.407325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48152 (local address 127.9.94.62:44737)
0808 07:07:11.407381 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:11.407383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:11.407560 (+ 177us) server_negotiation.cc:407] Connection header received
0808 07:07:11.407595 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:11.407596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:11.407608 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:11.407731 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:11.408280 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:11.409774 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:11.410964 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:11.411198 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:11.411260 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:11.412106 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:11.412107 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:11.412108 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:11.412364 (+ 256us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:11.412384 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:11.412391 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:11.412452 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:11.412555 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 07:07:11.412587 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:07:11.415441 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 12599
2026-08-08T07:07:11Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1429 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:07:11 dist-test-slave-77v9 krb5kdc[12702](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:07:11 dist-test-slave-77v9 krb5kdc[12702](info): set up 2 sockets
Aug 08 07:07:11 dist-test-slave-77v9 krb5kdc[12702](info): commencing operation
krb5kdc: starting...
W20260808 07:07:12.597080 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:07:12 dist-test-slave-77v9 krb5kdc[12702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:07:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:07:12.741273 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36143
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:36143
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:12.831485 12716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:12.831713 12716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:12.831736 12716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:12.832898 12716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:12.832937 12716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:12.832952 12716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:12.832965 12716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:12.832978 12716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:12.834412 12716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:36143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:12.834616 12716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:12.834796 12716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:12.839859 12721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:12.839869 12724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:12.839854 12722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:12.840183 12716 server_base.cc:1034] running on GCE node
I20260808 07:07:12.840404 12716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:12.840662 12716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:12.841820 12716 hybrid_clock.cc:648] HybridClock initialized: now 1786172832841805 us; error 31 us; skew 500 ppm
Aug 08 07:07:12 dist-test-slave-77v9 krb5kdc[12702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172832, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:12.844736 12716 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:07:12.845402 12716 webserver.cc:460] Webserver started at http://127.9.94.62:40287/ using document root <none> and password file <none>
I20260808 07:07:12.845669 12716 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:12.845805 12716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:12.845963 12716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:12.847244 12716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "37c1ca898a40404c8a38a1a5c15f90c5"
format_stamp: "Formatted at 2026-08-08 07:07:12 on dist-test-slave-77v9"
server_key: "73cd5689e231d595c4e7c64a251a7082"
server_key_iv: "7172a0b5405d68c25e68765cfe5c49a7"
server_key_version: "encryptionkey@0"
I20260808 07:07:12.847671 12716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "37c1ca898a40404c8a38a1a5c15f90c5"
format_stamp: "Formatted at 2026-08-08 07:07:12 on dist-test-slave-77v9"
server_key: "73cd5689e231d595c4e7c64a251a7082"
server_key_iv: "7172a0b5405d68c25e68765cfe5c49a7"
server_key_version: "encryptionkey@0"
I20260808 07:07:12.849539 12716 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 07:07:12.850416 12731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:12.850617 12716 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:12.850724 12716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "37c1ca898a40404c8a38a1a5c15f90c5"
format_stamp: "Formatted at 2026-08-08 07:07:12 on dist-test-slave-77v9"
server_key: "73cd5689e231d595c4e7c64a251a7082"
server_key_iv: "7172a0b5405d68c25e68765cfe5c49a7"
server_key_version: "encryptionkey@0"
I20260808 07:07:12.850802 12716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:12.859480 12716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:12.862170 12716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:12.862365 12716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:12.867182 12716 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:36143
I20260808 07:07:12.867274 12785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:36143 every 8 connection(s)
I20260808 07:07:12.867668 12716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:12.868876 12786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:12.871412 12786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5: Bootstrap starting.
I20260808 07:07:12.871984 12786 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:12.872215 12786 log.cc:824] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:12.873108 12786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5: No bootstrap required, opened a new log
I20260808 07:07:12.874826 12786 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37c1ca898a40404c8a38a1a5c15f90c5" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36143 } }
I20260808 07:07:12.874989 12786 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:12.875015 12786 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37c1ca898a40404c8a38a1a5c15f90c5, State: Initialized, Role: FOLLOWER
I20260808 07:07:12.875131 12786 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37c1ca898a40404c8a38a1a5c15f90c5" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36143 } }
I20260808 07:07:12.875190 12786 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:12.875212 12786 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:12.875241 12786 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:12.876111 12786 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37c1ca898a40404c8a38a1a5c15f90c5" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36143 } }
I20260808 07:07:12.876209 12786 leader_election.cc:302] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37c1ca898a40404c8a38a1a5c15f90c5; no voters:
I20260808 07:07:12.876343 12786 leader_election.cc:288] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:12.876407 12789 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:12.876591 12789 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [term 1 LEADER]: Becoming Leader. State: Replica: 37c1ca898a40404c8a38a1a5c15f90c5, State: Running, Role: LEADER
I20260808 07:07:12.876653 12786 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:12.876741 12789 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37c1ca898a40404c8a38a1a5c15f90c5" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36143 } }
I20260808 07:07:12.877179 12790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37c1ca898a40404c8a38a1a5c15f90c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37c1ca898a40404c8a38a1a5c15f90c5" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36143 } } }
I20260808 07:07:12.877393 12790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:12.877204 12791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37c1ca898a40404c8a38a1a5c15f90c5. Latest consensus state: current_term: 1 leader_uuid: "37c1ca898a40404c8a38a1a5c15f90c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37c1ca898a40404c8a38a1a5c15f90c5" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36143 } } }
I20260808 07:07:12.877820 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 12716
I20260808 07:07:12.877944 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:12.878149 9592 external_mini_cluster.cc:1428] Setting key 59e77ca3c81bffbfeecdec600f305aa8
I20260808 07:07:12.877586 12791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:12.878516 12798 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:12.879088 12798 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:12.880831 12798 catalog_manager.cc:1347] Generated new cluster ID: 2dd9f9d153d3490190a95557960a53b9
I20260808 07:07:12.880896 12798 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:07:12 dist-test-slave-77v9 krb5kdc[12702](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:12.889780 12808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:12.878754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51852 (local address 127.9.94.62:36143)
0808 07:07:12.878967 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:12.878978 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:12.879013 (+ 35us) server_negotiation.cc:407] Connection header received
0808 07:07:12.879148 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:12.879155 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:12.879217 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:12.879383 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:12.880161 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:12.881293 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:12.882071 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:12.882503 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:12.882624 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:12.885462 (+ 2838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:12.885467 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:12.885468 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:12.885483 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:12.887643 (+ 2160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:12.888101 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:12.888105 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:12.888105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:12.888239 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:12.888493 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:12.888495 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:12.888495 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:12.888794 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:12.889389 (+ 595us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:12.889455 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 07:07:12.889586 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":98,"threads_started":1}
I20260808 07:07:12.903254 12798 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:12.904018 12798 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:12.915266 12798 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37c1ca898a40404c8a38a1a5c15f90c5: Generated new TSK 0
I20260808 07:07:12.915493 12798 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:07:12.953879 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36143
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:13.046087 12813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:13.046309 12813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:13.046335 12813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:13.047770 12813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:13.047838 12813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:13.047873 12813 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:13.049614 12813 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:13.049919 12813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:13.050168 12813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:13.055958 12820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:13.055977 12819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:13.056128 12822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:13.056428 12813 server_base.cc:1034] running on GCE node
I20260808 07:07:13.056684 12813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:13.057090 12813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:13.058283 12813 hybrid_clock.cc:648] HybridClock initialized: now 1786172833058266 us; error 28 us; skew 500 ppm
Aug 08 07:07:13 dist-test-slave-77v9 krb5kdc[12702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172833, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:13.061792 12813 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:07:13.062743 12813 webserver.cc:460] Webserver started at http://127.9.94.1:35323/ using document root <none> and password file <none>
I20260808 07:07:13.063123 12813 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:13.063215 12813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:13.063411 12813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:13.064980 12813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "73c78583bf444bafb1cf9c89f324b67a"
format_stamp: "Formatted at 2026-08-08 07:07:13 on dist-test-slave-77v9"
server_key: "c9c7450e12699ab6cf0550a23616ddd8"
server_key_iv: "a6274d0a82d6f5bd5b1e239e55317c80"
server_key_version: "encryptionkey@0"
I20260808 07:07:13.065412 12813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "73c78583bf444bafb1cf9c89f324b67a"
format_stamp: "Formatted at 2026-08-08 07:07:13 on dist-test-slave-77v9"
server_key: "c9c7450e12699ab6cf0550a23616ddd8"
server_key_iv: "a6274d0a82d6f5bd5b1e239e55317c80"
server_key_version: "encryptionkey@0"
I20260808 07:07:13.067255 12813 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 07:07:13.068279 12829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:13.068560 12813 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:13.068679 12813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "73c78583bf444bafb1cf9c89f324b67a"
format_stamp: "Formatted at 2026-08-08 07:07:13 on dist-test-slave-77v9"
server_key: "c9c7450e12699ab6cf0550a23616ddd8"
server_key_iv: "a6274d0a82d6f5bd5b1e239e55317c80"
server_key_version: "encryptionkey@0"
I20260808 07:07:13.068761 12813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:13.089291 12813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:13.092747 12813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:13.092998 12813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:13.093266 12813 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:13.093720 12813 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:13.093834 12813 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:13.093884 12813 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:13.093926 12813 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:13.102046 12813 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:46111
I20260808 07:07:13.102210 12946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:46111 every 8 connection(s)
I20260808 07:07:13.102525 12813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:07:13 dist-test-slave-77v9 krb5kdc[12702](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172833, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:13.111203 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 12813
I20260808 07:07:13.111337 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:13.111580 9592 external_mini_cluster.cc:1428] Setting key e3ed6f243843b09ce52f7a881c3cf7f2
I20260808 07:07:13.115521 12808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:13.103672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:37875 (local address 127.9.94.62:36143)
0808 07:07:13.103767 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:13.103770 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:13.103936 (+ 166us) server_negotiation.cc:407] Connection header received
0808 07:07:13.104473 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:13.104475 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:13.104490 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:13.104556 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:13.105717 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.106350 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.107551 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.107783 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.107902 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:13.111110 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:13.111113 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:13.111113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:13.111125 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:13.113693 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:13.114204 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:13.114206 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:13.114206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:13.114289 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:13.114611 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:13.114612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:13.114612 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:13.114794 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:13.114877 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:13.115343 (+ 466us) server_negotiation.cc:299] Negotiation successful
0808 07:07:13.115450 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 07:07:13.115785 12949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:13.103558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36143 (local address 127.9.94.1:37875)
0808 07:07:13.103761 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:13.103808 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:13.104366 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:13.104635 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:13.104638 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:13.105367 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:13.105577 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:13.105583 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.106502 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.106503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:13.107423 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:13.107425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.108052 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.108053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:13.108177 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:13.108971 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:13.108987 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:13.110958 (+ 1971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:13.113812 (+ 2854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:13.113819 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:13.113821 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:13.114119 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:13.114401 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:13.114402 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:13.114402 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:13.114531 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:13.114884 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:13.114891 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:13.115146 (+ 255us) client_negotiation.cc:769] Sending connection context
0808 07:07:13.115284 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 07:07:13.115501 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":119,"threads_started":1}
I20260808 07:07:13.116601 12947 heartbeater.cc:347] Connected to a master server at 127.9.94.62:36143
I20260808 07:07:13.116704 12947 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:13.116966 12947 heartbeater.cc:511] Master 127.9.94.62:36143 requested a full tablet report, sending...
I20260808 07:07:13.117640 12748 ts_manager.cc:194] Registered new tserver with Master: 73c78583bf444bafb1cf9c89f324b67a (127.9.94.1:46111)
I20260808 07:07:13.118623 12748 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:37875
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:07:13.146339 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36143
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:13.242017 12952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:13.242317 12952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:13.242370 12952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:13.243724 12952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:13.243813 12952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:13.243870 12952 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:13.245628 12952 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:13.245972 12952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:13.246276 12952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:13.252370 12958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:13.252454 12952 server_base.cc:1034] running on GCE node
W20260808 07:07:13.252418 12957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:13.252377 12960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:13.252781 12952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:13.253105 12952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:13.254274 12952 hybrid_clock.cc:648] HybridClock initialized: now 1786172833254262 us; error 32 us; skew 500 ppm
Aug 08 07:07:13 dist-test-slave-77v9 krb5kdc[12702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172833, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:13.257192 12952 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:07:13.257705 12952 webserver.cc:460] Webserver started at http://127.9.94.2:41583/ using document root <none> and password file <none>
I20260808 07:07:13.257997 12952 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:13.258071 12952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:13.258232 12952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:13.259493 12952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "96491e66d3974ba4bf1f7bcf268a2eed"
format_stamp: "Formatted at 2026-08-08 07:07:13 on dist-test-slave-77v9"
server_key: "4128697c6a88f46fc6a81f58a73464d3"
server_key_iv: "dfbe0f4a912a1bc8aa2312ecb08e77a5"
server_key_version: "encryptionkey@0"
I20260808 07:07:13.259907 12952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "96491e66d3974ba4bf1f7bcf268a2eed"
format_stamp: "Formatted at 2026-08-08 07:07:13 on dist-test-slave-77v9"
server_key: "4128697c6a88f46fc6a81f58a73464d3"
server_key_iv: "dfbe0f4a912a1bc8aa2312ecb08e77a5"
server_key_version: "encryptionkey@0"
I20260808 07:07:13.261626 12952 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260808 07:07:13.262616 12968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:13.262931 12952 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:13.263037 12952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "96491e66d3974ba4bf1f7bcf268a2eed"
format_stamp: "Formatted at 2026-08-08 07:07:13 on dist-test-slave-77v9"
server_key: "4128697c6a88f46fc6a81f58a73464d3"
server_key_iv: "dfbe0f4a912a1bc8aa2312ecb08e77a5"
server_key_version: "encryptionkey@0"
I20260808 07:07:13.263132 12952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:13.282353 12952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:13.285096 12952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:13.285305 12952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:13.285578 12952 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:13.285923 12952 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:13.285980 12952 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:13.286023 12952 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:13.286053 12952 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:13.293672 12952 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:37697
I20260808 07:07:13.293895 13085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:37697 every 8 connection(s)
I20260808 07:07:13.294162 12952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:07:13 dist-test-slave-77v9 krb5kdc[12702](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172833, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:13.303438 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 12952
I20260808 07:07:13.303579 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:07:13.303798 9592 external_mini_cluster.cc:1428] Setting key 6b02435640a2de45ec8235728d1e4ef9
I20260808 07:07:13.306298 12808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:13.295091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:48781 (local address 127.9.94.62:36143)
0808 07:07:13.295186 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:13.295189 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:13.295507 (+ 318us) server_negotiation.cc:407] Connection header received
0808 07:07:13.296119 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:13.296121 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:13.296138 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:13.296231 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:13.297346 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.297946 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.299123 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.299332 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.299417 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:13.302129 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:13.302131 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:13.302131 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:13.302139 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:13.304114 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:13.304719 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:13.304723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:13.304724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:13.304909 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:13.305346 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:13.305348 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:13.305348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:13.305611 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:13.305733 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:13.306083 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 07:07:13.306193 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 07:07:13.306541 13088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:13.295012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36143 (local address 127.9.94.2:48781)
0808 07:07:13.295207 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:13.295314 (+ 107us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:13.295914 (+ 600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:13.296336 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:13.296340 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:13.297020 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:13.297234 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:13.297239 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.298065 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.298066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:13.299004 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:13.299007 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.299466 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.299468 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:13.299608 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:13.300196 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:13.300204 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:13.301982 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:13.304223 (+ 2241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:13.304235 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:13.304238 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:13.304566 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:13.305016 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:13.305018 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:13.305018 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:13.305236 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:13.305729 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:13.305740 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:13.305919 (+ 179us) client_negotiation.cc:769] Sending connection context
0808 07:07:13.306047 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 07:07:13.306237 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":108,"threads_started":1}
I20260808 07:07:13.307534 13086 heartbeater.cc:347] Connected to a master server at 127.9.94.62:36143
I20260808 07:07:13.307641 13086 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:13.307852 13086 heartbeater.cc:511] Master 127.9.94.62:36143 requested a full tablet report, sending...
I20260808 07:07:13.308264 12748 ts_manager.cc:194] Registered new tserver with Master: 96491e66d3974ba4bf1f7bcf268a2eed (127.9.94.2:37697)
I20260808 07:07:13.308799 12748 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:48781
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:07:13.341176 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36143
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:13.435634 13091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:13.435859 13091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:13.435886 13091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:13.437218 13091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:13.437263 13091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:13.437294 13091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:13.438838 13091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13091
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:13.439091 13091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:13.439342 13091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:13.445263 13097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:13.445258 13099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:13.445310 13091 server_base.cc:1034] running on GCE node
W20260808 07:07:13.445288 13096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:13.445761 13091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:13.446066 13091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:13.447260 13091 hybrid_clock.cc:648] HybridClock initialized: now 1786172833447245 us; error 27 us; skew 500 ppm
Aug 08 07:07:13 dist-test-slave-77v9 krb5kdc[12702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172833, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:13.450315 13091 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:07:13.450850 13091 webserver.cc:460] Webserver started at http://127.9.94.3:42853/ using document root <none> and password file <none>
I20260808 07:07:13.451200 13091 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:13.451292 13091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:13.451481 13091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:13.452803 13091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "89d78bc37f9641989fe56708f1f1569d"
format_stamp: "Formatted at 2026-08-08 07:07:13 on dist-test-slave-77v9"
server_key: "9828a2a47c2dea3e463fd1e3407bf725"
server_key_iv: "6d1a343cc397abbf3bb742d53bcd98da"
server_key_version: "encryptionkey@0"
I20260808 07:07:13.453473 13091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "89d78bc37f9641989fe56708f1f1569d"
format_stamp: "Formatted at 2026-08-08 07:07:13 on dist-test-slave-77v9"
server_key: "9828a2a47c2dea3e463fd1e3407bf725"
server_key_iv: "6d1a343cc397abbf3bb742d53bcd98da"
server_key_version: "encryptionkey@0"
I20260808 07:07:13.455389 13091 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260808 07:07:13.456380 13106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:13.456681 13091 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:13.456902 13091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "89d78bc37f9641989fe56708f1f1569d"
format_stamp: "Formatted at 2026-08-08 07:07:13 on dist-test-slave-77v9"
server_key: "9828a2a47c2dea3e463fd1e3407bf725"
server_key_iv: "6d1a343cc397abbf3bb742d53bcd98da"
server_key_version: "encryptionkey@0"
I20260808 07:07:13.457209 13091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:13.485989 13091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:13.488605 13091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:13.488824 13091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:13.489113 13091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:13.489463 13091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:13.489517 13091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:13.489562 13091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:13.489593 13091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:13.496248 13091 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:32811
I20260808 07:07:13.496300 13220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:32811 every 8 connection(s)
I20260808 07:07:13.496672 13091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:07:13.498458 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 13091
I20260808 07:07:13.498561 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:07:13.498764 9592 external_mini_cluster.cc:1428] Setting key b202888e5607c0146c15fbc96a51dd0f
Aug 08 07:07:13 dist-test-slave-77v9 krb5kdc[12702](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172833, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:13.507891 12808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:13.497591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:47329 (local address 127.9.94.62:36143)
0808 07:07:13.497667 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:13.497669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:13.497845 (+ 176us) server_negotiation.cc:407] Connection header received
0808 07:07:13.498349 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:13.498372 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:13.498384 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:13.498452 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:13.499749 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.500306 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.501576 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.501802 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.501878 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:13.504345 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:13.504346 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:13.504347 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:13.504355 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:13.506100 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:13.506664 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:13.506666 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:13.506666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:13.506749 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:13.507097 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:13.507098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:13.507099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:13.507256 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:13.507328 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:13.507699 (+ 371us) server_negotiation.cc:299] Negotiation successful
0808 07:07:13.507821 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 07:07:13.507987 13223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:13.497495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36143 (local address 127.9.94.3:47329)
0808 07:07:13.497684 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:13.497728 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:13.498215 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:13.498552 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:13.498557 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:13.499378 (+ 821us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:13.499661 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:13.499667 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.500430 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.500431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:13.501460 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:13.501463 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.501923 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.501924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:13.502050 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:13.502597 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:13.502606 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:13.504242 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:13.506203 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:13.506222 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:13.506224 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:13.506546 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:13.506846 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:13.506847 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:13.506847 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:13.507008 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:13.507325 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:13.507333 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:13.507524 (+ 191us) client_negotiation.cc:769] Sending connection context
0808 07:07:13.507631 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 07:07:13.507776 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":93,"threads_started":1}
I20260808 07:07:13.508925 13221 heartbeater.cc:347] Connected to a master server at 127.9.94.62:36143
I20260808 07:07:13.509033 13221 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:13.509229 13221 heartbeater.cc:511] Master 127.9.94.62:36143 requested a full tablet report, sending...
I20260808 07:07:13.509675 12748 ts_manager.cc:194] Registered new tserver with Master: 89d78bc37f9641989fe56708f1f1569d (127.9.94.3:32811)
I20260808 07:07:13.510119 12748 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:47329
I20260808 07:07:13.510741 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 07:07:13 dist-test-slave-77v9 krb5kdc[12702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172833, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 07:07:13 dist-test-slave-77v9 krb5kdc[12702](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172833, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:13.536875 12808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:13.529141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51864 (local address 127.9.94.62:36143)
0808 07:07:13.529212 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:13.529214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:13.529344 (+ 130us) server_negotiation.cc:407] Connection header received
0808 07:07:13.529439 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:13.529440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:13.529454 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:13.529516 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:13.530146 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.530667 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.531465 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.531657 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.531755 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:13.534225 (+ 2470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:13.534226 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:13.534227 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:13.534235 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:13.535646 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:13.536014 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:13.536015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:13.536016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:13.536071 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:13.536265 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:13.536266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:13.536267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:13.536430 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:13.536547 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:13.536645 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 07:07:13.536731 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 07:07:13.537129 12748 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:51864
I20260808 07:07:13.538040 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 12813
I20260808 07:07:13.544201 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 12952
I20260808 07:07:13.551319 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 13091
I20260808 07:07:13.558369 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 12716
2026-08-08T07:07:13Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2142 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:07:13 dist-test-slave-77v9 krb5kdc[13233](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:07:13 dist-test-slave-77v9 krb5kdc[13233](info): set up 2 sockets
Aug 08 07:07:13 dist-test-slave-77v9 krb5kdc[13233](info): commencing operation
krb5kdc: starting...
W20260808 07:07:14.731407 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:07:14 dist-test-slave-77v9 krb5kdc[13233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:07:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:07:14.882182 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36825
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:40959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:36825
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:14.974059 13246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:14.974308 13246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:14.974334 13246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:14.975718 13246 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:14.975793 13246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:14.975812 13246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:14.975834 13246 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:14.975847 13246 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:14.977766 13246 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:40959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:36825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:14.978014 13246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:14.978210 13246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:14.984153 13253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:14.984114 13251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:14.984163 13246 server_base.cc:1034] running on GCE node
W20260808 07:07:14.984123 13255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:14.984716 13246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:14.985113 13246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:14.986289 13246 hybrid_clock.cc:648] HybridClock initialized: now 1786172834986266 us; error 45 us; skew 500 ppm
Aug 08 07:07:14 dist-test-slave-77v9 krb5kdc[13233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172834, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:14.989457 13246 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:07:14.990083 13246 webserver.cc:460] Webserver started at http://127.9.94.62:35205/ using document root <none> and password file <none>
I20260808 07:07:14.990370 13246 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:14.990423 13246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:14.990568 13246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:14.991743 13246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "7dd68694370742f9b549754f71bcd9f6"
format_stamp: "Formatted at 2026-08-08 07:07:14 on dist-test-slave-77v9"
server_key: "8e1de20bea8113b340b0b958474f7bf0"
server_key_iv: "a56fbced39d45d2c018181b0c809d5f9"
server_key_version: "encryptionkey@0"
I20260808 07:07:14.992130 13246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "7dd68694370742f9b549754f71bcd9f6"
format_stamp: "Formatted at 2026-08-08 07:07:14 on dist-test-slave-77v9"
server_key: "8e1de20bea8113b340b0b958474f7bf0"
server_key_iv: "a56fbced39d45d2c018181b0c809d5f9"
server_key_version: "encryptionkey@0"
I20260808 07:07:14.993867 13246 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:07:14.994963 13262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:14.995222 13246 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:14.995347 13246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "7dd68694370742f9b549754f71bcd9f6"
format_stamp: "Formatted at 2026-08-08 07:07:14 on dist-test-slave-77v9"
server_key: "8e1de20bea8113b340b0b958474f7bf0"
server_key_iv: "a56fbced39d45d2c018181b0c809d5f9"
server_key_version: "encryptionkey@0"
I20260808 07:07:14.995446 13246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:15.010181 13246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:15.013579 13246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:15.013787 13246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:15.019249 13246 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:36825
I20260808 07:07:15.019342 13317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:36825 every 8 connection(s)
I20260808 07:07:15.019914 13246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:15.020746 13318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:15.023518 13318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6: Bootstrap starting.
I20260808 07:07:15.024144 13318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:15.024410 13318 log.cc:824] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:15.025364 13318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6: No bootstrap required, opened a new log
I20260808 07:07:15.027132 13318 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd68694370742f9b549754f71bcd9f6" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36825 } }
I20260808 07:07:15.027293 13318 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:15.027320 13318 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd68694370742f9b549754f71bcd9f6, State: Initialized, Role: FOLLOWER
I20260808 07:07:15.027587 13318 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd68694370742f9b549754f71bcd9f6" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36825 } }
I20260808 07:07:15.027694 13318 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:15.027722 13318 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:15.027756 13318 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:15.028781 13318 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd68694370742f9b549754f71bcd9f6" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36825 } }
I20260808 07:07:15.028923 13318 leader_election.cc:302] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7dd68694370742f9b549754f71bcd9f6; no voters:
I20260808 07:07:15.029073 13318 leader_election.cc:288] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:15.029170 13321 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:15.029388 13318 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:15.029459 13321 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [term 1 LEADER]: Becoming Leader. State: Replica: 7dd68694370742f9b549754f71bcd9f6, State: Running, Role: LEADER
I20260808 07:07:15.029462 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 13246
I20260808 07:07:15.029572 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:15.029654 13321 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd68694370742f9b549754f71bcd9f6" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36825 } }
I20260808 07:07:15.029795 9592 external_mini_cluster.cc:1428] Setting key a437c821c0ab39996a9a93726d6551da
I20260808 07:07:15.030143 13322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7dd68694370742f9b549754f71bcd9f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd68694370742f9b549754f71bcd9f6" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36825 } } }
I20260808 07:07:15.030243 13322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:15.030433 13323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7dd68694370742f9b549754f71bcd9f6. Latest consensus state: current_term: 1 leader_uuid: "7dd68694370742f9b549754f71bcd9f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd68694370742f9b549754f71bcd9f6" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36825 } } }
I20260808 07:07:15.030489 13323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:15.030954 13331 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:15.031605 13331 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:15.033324 13331 catalog_manager.cc:1347] Generated new cluster ID: 8b1d34f6c1bd489f9009fcd0232afd0c
I20260808 07:07:15.033394 13331 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:07:15 dist-test-slave-77v9 krb5kdc[13233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:15.042840 13332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:15.030485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38406 (local address 127.9.94.62:36825)
0808 07:07:15.030858 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:15.030868 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:15.030912 (+ 44us) server_negotiation.cc:407] Connection header received
0808 07:07:15.031049 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:15.031057 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:15.031134 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:15.032154 (+ 1020us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:15.032269 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.033641 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.034722 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.035425 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.035558 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:15.038584 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:15.038589 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:15.038589 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:15.038602 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:15.040954 (+ 2352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:15.041412 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:15.041416 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:15.041416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:15.041539 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:15.041775 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:15.041776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:15.041776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:15.042121 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:15.042283 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:15.042415 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 07:07:15.042578 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":95,"threads_started":1}
I20260808 07:07:15.044504 13331 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:15.045212 13331 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:15.050859 13331 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7dd68694370742f9b549754f71bcd9f6: Generated new TSK 0
I20260808 07:07:15.051088 13331 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:07:15.085137 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36825
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:40959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:15.192765 13344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:15.193089 13344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:15.193120 13344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:15.194500 13344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:15.194556 13344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:15.194588 13344 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:15.196532 13344 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:40959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36825
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:15.197278 13344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:15.197528 13344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:15.203136 13352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:15.203152 13349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:15.203158 13350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:15.203503 13344 server_base.cc:1034] running on GCE node
I20260808 07:07:15.203742 13344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:15.204069 13344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:15.205263 13344 hybrid_clock.cc:648] HybridClock initialized: now 1786172835205261 us; error 44 us; skew 500 ppm
Aug 08 07:07:15 dist-test-slave-77v9 krb5kdc[13233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172835, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:15.208544 13344 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:07:15.209246 13344 webserver.cc:460] Webserver started at http://127.9.94.1:40027/ using document root <none> and password file <none>
I20260808 07:07:15.209556 13344 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:15.209640 13344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:15.209800 13344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:15.210916 13344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "ef11f5b9993f49949d9af4f6d9338eec"
format_stamp: "Formatted at 2026-08-08 07:07:15 on dist-test-slave-77v9"
server_key: "90e6738ab91d75f06f1d013f728d09bf"
server_key_iv: "897cd4733fe2e2b726564d249af98125"
server_key_version: "encryptionkey@0"
I20260808 07:07:15.211301 13344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "ef11f5b9993f49949d9af4f6d9338eec"
format_stamp: "Formatted at 2026-08-08 07:07:15 on dist-test-slave-77v9"
server_key: "90e6738ab91d75f06f1d013f728d09bf"
server_key_iv: "897cd4733fe2e2b726564d249af98125"
server_key_version: "encryptionkey@0"
I20260808 07:07:15.213052 13344 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:07:15.214039 13359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:15.214406 13344 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:15.214546 13344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "ef11f5b9993f49949d9af4f6d9338eec"
format_stamp: "Formatted at 2026-08-08 07:07:15 on dist-test-slave-77v9"
server_key: "90e6738ab91d75f06f1d013f728d09bf"
server_key_iv: "897cd4733fe2e2b726564d249af98125"
server_key_version: "encryptionkey@0"
I20260808 07:07:15.214641 13344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:15.224467 13344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:15.227165 13344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:15.227358 13344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:15.227626 13344 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:15.227963 13344 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:15.228022 13344 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:15.228068 13344 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:15.228098 13344 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:15.236224 13344 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:38397
I20260808 07:07:15.236269 13477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:38397 every 8 connection(s)
I20260808 07:07:15.236730 13344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:07:15.242486 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 13344
I20260808 07:07:15.242606 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:15.242781 9592 external_mini_cluster.cc:1428] Setting key bacc59a093375fda45372b1558a72395
Aug 08 07:07:15 dist-test-slave-77v9 krb5kdc[13233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172835, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:15.251286 13332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:15.237761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:41457 (local address 127.9.94.62:36825)
0808 07:07:15.238026 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:15.238028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:15.238042 (+ 14us) server_negotiation.cc:407] Connection header received
0808 07:07:15.239002 (+ 960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:15.239004 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:15.239019 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:15.239089 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:15.239885 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.240455 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.242230 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.242537 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.242822 (+ 285us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:15.246129 (+ 3307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:15.246131 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:15.246132 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:15.246158 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:15.248539 (+ 2381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:15.249686 (+ 1147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:15.249688 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:15.249688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:15.249844 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:15.250370 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:15.250371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:15.250371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:15.250527 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:15.250602 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:15.251064 (+ 462us) server_negotiation.cc:299] Negotiation successful
0808 07:07:15.251193 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 07:07:15.251535 13480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:15.237624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36825 (local address 127.9.94.1:41457)
0808 07:07:15.237805 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:15.237856 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:15.238869 (+ 1013us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:15.239240 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:15.239244 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:15.239556 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:15.239765 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:15.239769 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.240697 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.240699 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:15.242037 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:15.242043 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.242846 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.242847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:15.243209 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:15.243849 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:15.243857 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:15.245909 (+ 2052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:15.249061 (+ 3152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:15.249076 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:15.249079 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:15.249526 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:15.250047 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:15.250048 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:15.250049 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:15.250225 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:15.250612 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:15.250619 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:15.250843 (+ 224us) client_negotiation.cc:769] Sending connection context
0808 07:07:15.250987 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 07:07:15.251229 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":100,"threads_started":1}
I20260808 07:07:15.252375 13478 heartbeater.cc:347] Connected to a master server at 127.9.94.62:36825
I20260808 07:07:15.252525 13478 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:15.252980 13478 heartbeater.cc:511] Master 127.9.94.62:36825 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
I20260808 07:07:15.253731 13280 ts_manager.cc:194] Registered new tserver with Master: ef11f5b9993f49949d9af4f6d9338eec (127.9.94.1:38397)
I20260808 07:07:15.254415 13280 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:41457
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:07:15.277915 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36825
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:40959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:15.372541 13483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:15.372835 13483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:15.372905 13483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:15.374137 13483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:15.374217 13483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:15.374269 13483 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:15.375880 13483 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:40959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36825
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:15.376173 13483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:15.376425 13483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:15.382656 13491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:15.382637 13483 server_base.cc:1034] running on GCE node
W20260808 07:07:15.382622 13488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:15.382794 13489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:15.383219 13483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:15.383534 13483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:15.384733 13483 hybrid_clock.cc:648] HybridClock initialized: now 1786172835384728 us; error 40 us; skew 500 ppm
Aug 08 07:07:15 dist-test-slave-77v9 krb5kdc[13233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172835, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:15.387657 13483 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:07:15.388309 13483 webserver.cc:460] Webserver started at http://127.9.94.2:43683/ using document root <none> and password file <none>
I20260808 07:07:15.388612 13483 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:15.388688 13483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:15.388902 13483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:15.390050 13483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "dfb95e78ebdd4b88a48fb1d8c2515fb6"
format_stamp: "Formatted at 2026-08-08 07:07:15 on dist-test-slave-77v9"
server_key: "bae08ab1f30515101f81de905d7851e2"
server_key_iv: "c384d6c3b67412b39d16e0fb7203368a"
server_key_version: "encryptionkey@0"
I20260808 07:07:15.390451 13483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "dfb95e78ebdd4b88a48fb1d8c2515fb6"
format_stamp: "Formatted at 2026-08-08 07:07:15 on dist-test-slave-77v9"
server_key: "bae08ab1f30515101f81de905d7851e2"
server_key_iv: "c384d6c3b67412b39d16e0fb7203368a"
server_key_version: "encryptionkey@0"
I20260808 07:07:15.392200 13483 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:07:15.393676 13498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:15.394027 13483 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:15.394166 13483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "dfb95e78ebdd4b88a48fb1d8c2515fb6"
format_stamp: "Formatted at 2026-08-08 07:07:15 on dist-test-slave-77v9"
server_key: "bae08ab1f30515101f81de905d7851e2"
server_key_iv: "c384d6c3b67412b39d16e0fb7203368a"
server_key_version: "encryptionkey@0"
I20260808 07:07:15.394265 13483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:15.422686 13483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:15.425523 13483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:15.425824 13483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:15.426126 13483 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:15.426553 13483 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:15.426646 13483 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:15.426717 13483 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:15.426739 13483 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:15.435467 13483 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:35463
I20260808 07:07:15.435926 13483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:07:15.436362 13614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:35463 every 8 connection(s)
Aug 08 07:07:15 dist-test-slave-77v9 krb5kdc[13233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172835, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:15.445768 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 13483
I20260808 07:07:15.445950 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:07:15.446156 9592 external_mini_cluster.cc:1428] Setting key 90caa09bd92f3f3a35abf4ba77527bc8
I20260808 07:07:15.447492 13332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:15.437881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:49893 (local address 127.9.94.62:36825)
0808 07:07:15.437947 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:15.437950 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:15.437967 (+ 17us) server_negotiation.cc:407] Connection header received
0808 07:07:15.438558 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:15.438559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:15.438574 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:15.438629 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:15.439346 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.439907 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.441151 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.441391 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.441479 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:15.444104 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:15.444106 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:15.444106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:15.444115 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:15.445773 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:15.446311 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:15.446313 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:15.446313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:15.446388 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:15.446693 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:15.446694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:15.446695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:15.446845 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:15.446941 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:15.447329 (+ 388us) server_negotiation.cc:299] Negotiation successful
0808 07:07:15.447422 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:07:15.447810 13617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:15.436913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36825 (local address 127.9.94.2:49893)
0808 07:07:15.437107 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:15.437157 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:15.438427 (+ 1270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:15.438705 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:15.438710 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:15.439018 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:15.439227 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:15.439232 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.440042 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.440044 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:15.441033 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:15.441036 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.441487 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.441488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:15.441637 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:15.442286 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:15.442295 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:15.443974 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:15.445893 (+ 1919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:15.445906 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:15.445908 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:15.446219 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:15.446489 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:15.446490 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:15.446491 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:15.446618 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:15.446932 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:15.446945 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:15.447143 (+ 198us) client_negotiation.cc:769] Sending connection context
0808 07:07:15.447282 (+ 139us) client_negotiation.cc:240] Negotiation successful
0808 07:07:15.447489 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":92,"threads_started":1}
I20260808 07:07:15.448472 13615 heartbeater.cc:347] Connected to a master server at 127.9.94.62:36825
I20260808 07:07:15.448642 13615 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:15.448907 13615 heartbeater.cc:511] Master 127.9.94.62:36825 requested a full tablet report, sending...
I20260808 07:07:15.449467 13280 ts_manager.cc:194] Registered new tserver with Master: dfb95e78ebdd4b88a48fb1d8c2515fb6 (127.9.94.2:35463)
I20260808 07:07:15.450037 13280 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:49893
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:07:15.485351 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36825
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:40959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:15.582607 13620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:15.582842 13620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:15.582880 13620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:15.584336 13620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:15.584419 13620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:15.584455 13620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:15.586417 13620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:40959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36825
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:15.586766 13620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:15.587186 13620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:15.593356 13626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:15.593441 13625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:15.593329 13628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:15.594228 13620 server_base.cc:1034] running on GCE node
I20260808 07:07:15.594512 13620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:15.594794 13620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:15.596019 13620 hybrid_clock.cc:648] HybridClock initialized: now 1786172835595993 us; error 46 us; skew 500 ppm
Aug 08 07:07:15 dist-test-slave-77v9 krb5kdc[13233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172835, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:15.599153 13620 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:07:15.599841 13620 webserver.cc:460] Webserver started at http://127.9.94.3:45703/ using document root <none> and password file <none>
I20260808 07:07:15.600150 13620 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:15.600225 13620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:15.600389 13620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:15.601588 13620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "bb6e48aa40d24d2eb1ac0009c2a37f09"
format_stamp: "Formatted at 2026-08-08 07:07:15 on dist-test-slave-77v9"
server_key: "7fca5ebb1f39ec2df2979389559a037f"
server_key_iv: "8eee14af8e1febbbda9a86b5199126df"
server_key_version: "encryptionkey@0"
I20260808 07:07:15.601986 13620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "bb6e48aa40d24d2eb1ac0009c2a37f09"
format_stamp: "Formatted at 2026-08-08 07:07:15 on dist-test-slave-77v9"
server_key: "7fca5ebb1f39ec2df2979389559a037f"
server_key_iv: "8eee14af8e1febbbda9a86b5199126df"
server_key_version: "encryptionkey@0"
I20260808 07:07:15.603525 13620 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:07:15.604501 13635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:15.604718 13620 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:15.604853 13620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "bb6e48aa40d24d2eb1ac0009c2a37f09"
format_stamp: "Formatted at 2026-08-08 07:07:15 on dist-test-slave-77v9"
server_key: "7fca5ebb1f39ec2df2979389559a037f"
server_key_iv: "8eee14af8e1febbbda9a86b5199126df"
server_key_version: "encryptionkey@0"
I20260808 07:07:15.604990 13620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:15.614050 13620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:15.616451 13620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:15.616627 13620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:15.616940 13620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:15.617297 13620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:15.617355 13620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:15.617393 13620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:15.617419 13620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:15.624197 13620 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:42009
I20260808 07:07:15.624377 13751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:42009 every 8 connection(s)
I20260808 07:07:15.624653 13620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:07:15 dist-test-slave-77v9 krb5kdc[13233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172835, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:15.633703 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 13620
I20260808 07:07:15.633837 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:07:15.634075 9592 external_mini_cluster.cc:1428] Setting key 55e074913513c607d8bdb9a37fb02955
I20260808 07:07:15.638763 13332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:15.625613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:32905 (local address 127.9.94.62:36825)
0808 07:07:15.625712 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:15.625715 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:15.626169 (+ 454us) server_negotiation.cc:407] Connection header received
0808 07:07:15.627634 (+ 1465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:15.627638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:15.627655 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:15.627747 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:15.628660 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.629343 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.630755 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.631039 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.631161 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:15.634363 (+ 3202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:15.634365 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:15.634366 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:15.634375 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:15.636444 (+ 2069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:15.637477 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:15.637478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:15.637478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:15.637553 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:15.637994 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:15.637995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:15.637996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:15.638133 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:15.638196 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:15.638598 (+ 402us) server_negotiation.cc:299] Negotiation successful
0808 07:07:15.638683 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 07:07:15.639036 13754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:15.625563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36825 (local address 127.9.94.3:32905)
0808 07:07:15.625917 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:15.625989 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:15.627410 (+ 1421us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:15.628005 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:15.628009 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:15.628297 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:15.628505 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:15.628510 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.629483 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.629484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:15.630571 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:15.630574 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.631169 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.631170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:15.631307 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:15.632007 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:15.632025 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:15.634229 (+ 2204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:15.636739 (+ 2510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:15.636758 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:15.636763 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:15.637306 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:15.637688 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:15.637689 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:15.637690 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:15.637866 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:15.638228 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:15.638236 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:15.638415 (+ 179us) client_negotiation.cc:769] Sending connection context
0808 07:07:15.638541 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 07:07:15.638718 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":120,"threads_started":1}
I20260808 07:07:15.640195 13752 heartbeater.cc:347] Connected to a master server at 127.9.94.62:36825
I20260808 07:07:15.640350 13752 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:15.640579 13752 heartbeater.cc:511] Master 127.9.94.62:36825 requested a full tablet report, sending...
I20260808 07:07:15.641194 13280 ts_manager.cc:194] Registered new tserver with Master: bb6e48aa40d24d2eb1ac0009c2a37f09 (127.9.94.3:42009)
I20260808 07:07:15.641620 13280 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:32905
I20260808 07:07:15.646785 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 07:07:15 dist-test-slave-77v9 krb5kdc[13233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 07:07:15 dist-test-slave-77v9 krb5kdc[13233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.1@KRBTEST.COM
I20260808 07:07:15.677525 13759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:15.667631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35298 (local address 127.9.94.1:38397)
0808 07:07:15.667869 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:15.667875 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:15.667885 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:07:15.667913 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:15.667915 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:15.667929 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:15.668001 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:15.668711 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.669562 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.670455 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.670794 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.670910 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:15.674215 (+ 3305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:15.674224 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:15.674224 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:15.674232 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:15.676073 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:15.676477 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:15.676480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:15.676480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:15.676542 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:15.676777 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:15.676778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:15.676779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:15.677042 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:15.677164 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:15.677328 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 07:07:15.677404 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":124,"threads_started":1}
Aug 08 07:07:15 dist-test-slave-77v9 krb5kdc[13233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:15.688077 13332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:15.679383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38420 (local address 127.9.94.62:36825)
0808 07:07:15.679446 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:15.679448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:15.679457 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:15.679506 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:15.679507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:15.679516 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:15.679558 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:15.680118 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.680678 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.681597 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:15.681835 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:15.681901 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:15.684936 (+ 3035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:15.684938 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:15.684938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:15.684946 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:15.686617 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:15.687042 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:15.687042 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:15.687043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:15.687103 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:15.687378 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:15.687379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:15.687379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:15.687571 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:15.687678 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:15.687914 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 07:07:15.688002 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 07:07:15.688483 13280 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38420
I20260808 07:07:15.689261 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 13344
I20260808 07:07:15.696511 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 13483
I20260808 07:07:15.702477 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 13620
I20260808 07:07:15.709621 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 13246
2026-08-08T07:07:15Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2152 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:07:15 dist-test-slave-77v9 krb5kdc[13764](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:07:15 dist-test-slave-77v9 krb5kdc[13764](info): set up 2 sockets
Aug 08 07:07:15 dist-test-slave-77v9 krb5kdc[13764](info): commencing operation
krb5kdc: starting...
W20260808 07:07:16.897053 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:07:16 dist-test-slave-77v9 krb5kdc[13764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:07:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:07:17.045778 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:37523
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:37523
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:17.142071 13778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:17.142309 13778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:17.142334 13778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:17.143477 13778 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:17.143517 13778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:17.143532 13778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:17.143544 13778 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:17.143560 13778 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:17.145116 13778 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:37523
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:37523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:17.145373 13778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:17.145574 13778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:17.151171 13786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:17.151238 13783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:17.151257 13784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:17.151445 13778 server_base.cc:1034] running on GCE node
I20260808 07:07:17.151742 13778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:17.152123 13778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:17.153294 13778 hybrid_clock.cc:648] HybridClock initialized: now 1786172837153279 us; error 36 us; skew 500 ppm
Aug 08 07:07:17 dist-test-slave-77v9 krb5kdc[13764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172837, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:17.156381 13778 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:07:17.156762 13778 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:17.156875 13778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:17.157012 13778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:17.158171 13778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "f65f5b5b0a27480aaf300d612723423e"
format_stamp: "Formatted at 2026-08-08 07:07:17 on dist-test-slave-77v9"
server_key: "cdd604352483e46d70ba87c91006f5e3"
server_key_iv: "408b9150f785193376c682f1e4c91b23"
server_key_version: "encryptionkey@0"
I20260808 07:07:17.158563 13778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "f65f5b5b0a27480aaf300d612723423e"
format_stamp: "Formatted at 2026-08-08 07:07:17 on dist-test-slave-77v9"
server_key: "cdd604352483e46d70ba87c91006f5e3"
server_key_iv: "408b9150f785193376c682f1e4c91b23"
server_key_version: "encryptionkey@0"
I20260808 07:07:17.160120 13778 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:07:17.161072 13792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:17.161295 13778 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:17.161422 13778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "f65f5b5b0a27480aaf300d612723423e"
format_stamp: "Formatted at 2026-08-08 07:07:17 on dist-test-slave-77v9"
server_key: "cdd604352483e46d70ba87c91006f5e3"
server_key_iv: "408b9150f785193376c682f1e4c91b23"
server_key_version: "encryptionkey@0"
I20260808 07:07:17.161504 13778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:17.181768 13778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:17.184794 13778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:17.185122 13778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:17.190088 13778 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:37523
I20260808 07:07:17.190166 13845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:37523 every 8 connection(s)
I20260808 07:07:17.190470 13778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:17.191635 13846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:17.192888 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 13778
I20260808 07:07:17.193107 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:17.193351 9592 external_mini_cluster.cc:1428] Setting key e7fc2e1f0ea9ce475a90ade33a2cdfc9
I20260808 07:07:17.195199 13846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e: Bootstrap starting.
I20260808 07:07:17.196156 13846 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:17.196523 13846 log.cc:824] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:17.197758 13846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e: No bootstrap required, opened a new log
I20260808 07:07:17.200551 13846 raft_consensus.cc:348] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f65f5b5b0a27480aaf300d612723423e" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37523 } }
I20260808 07:07:17.200722 13846 raft_consensus.cc:374] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:17.200747 13846 raft_consensus.cc:729] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f65f5b5b0a27480aaf300d612723423e, State: Initialized, Role: FOLLOWER
I20260808 07:07:17.200929 13846 consensus_queue.cc:260] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f65f5b5b0a27480aaf300d612723423e" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37523 } }
I20260808 07:07:17.201018 13846 raft_consensus.cc:388] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:17.201047 13846 raft_consensus.cc:482] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:17.201095 13846 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [term 0 FOLLOWER]: Advancing to term 1
Aug 08 07:07:17 dist-test-slave-77v9 krb5kdc[13764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:17.201860 13846 raft_consensus.cc:504] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f65f5b5b0a27480aaf300d612723423e" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37523 } }
I20260808 07:07:17.202003 13846 leader_election.cc:302] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f65f5b5b0a27480aaf300d612723423e; no voters:
I20260808 07:07:17.202231 13846 leader_election.cc:288] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:17.202263 13851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:17.202373 13851 raft_consensus.cc:686] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [term 1 LEADER]: Becoming Leader. State: Replica: f65f5b5b0a27480aaf300d612723423e, State: Running, Role: LEADER
I20260808 07:07:17.202472 13851 consensus_queue.cc:237] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f65f5b5b0a27480aaf300d612723423e" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37523 } }
I20260808 07:07:17.202521 13846 sys_catalog.cc:564] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:17.202860 13851 sys_catalog.cc:455] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f65f5b5b0a27480aaf300d612723423e. Latest consensus state: current_term: 1 leader_uuid: "f65f5b5b0a27480aaf300d612723423e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f65f5b5b0a27480aaf300d612723423e" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37523 } } }
I20260808 07:07:17.202937 13851 sys_catalog.cc:458] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:17.202893 13852 sys_catalog.cc:455] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f65f5b5b0a27480aaf300d612723423e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f65f5b5b0a27480aaf300d612723423e" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37523 } } }
I20260808 07:07:17.204293 13852 sys_catalog.cc:458] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e [sys.catalog]: This master's current role is: LEADER
W20260808 07:07:17.204607 13868 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:07:17.204895 13868 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:07:17.204982 13855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:17.205183 13855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:17.206622 13849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.193983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34566 (local address 127.9.94.62:37523)
0808 07:07:17.194171 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:17.194180 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:17.194208 (+ 28us) server_negotiation.cc:407] Connection header received
0808 07:07:17.194817 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:17.194824 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:17.194878 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:17.195018 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:17.195986 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.197099 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.198177 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.198598 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.198691 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.201800 (+ 3109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:17.201805 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:17.201805 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:17.201820 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:17.204153 (+ 2333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:17.204691 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:17.204695 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:17.204695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:17.204992 (+ 297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:17.205291 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:17.205292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:17.205293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:17.205663 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:17.205867 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:17.206277 (+ 410us) server_negotiation.cc:299] Negotiation successful
0808 07:07:17.206430 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":99,"threads_started":1}
I20260808 07:07:17.206959 13855 catalog_manager.cc:1347] Generated new cluster ID: ae09ebf12bf6498f89f41895d88661cf
I20260808 07:07:17.207017 13855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:17.236275 13855 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:17.237227 13855 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:17.241261 13855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e: Generated new TSK 0
I20260808 07:07:17.241503 13855 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:07:17.285964 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37523
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:17.385442 13874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:17.385704 13874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:17.385735 13874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:17.387147 13874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:17.387203 13874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:17.387235 13874 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:17.388988 13874 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37523
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13874
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:17.389299 13874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:17.389566 13874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:17.396607 13879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:17.396896 13882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:17.396963 13880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:17.397320 13874 server_base.cc:1034] running on GCE node
I20260808 07:07:17.397595 13874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:17.398023 13874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:17.399209 13874 hybrid_clock.cc:648] HybridClock initialized: now 1786172837399152 us; error 72 us; skew 500 ppm
Aug 08 07:07:17 dist-test-slave-77v9 krb5kdc[13764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172837, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:17.402346 13874 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:07:17.402818 13874 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:17.402899 13874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:17.403062 13874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:17.404402 13874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "d130d2b6f9a94198bf6de401ffcc0f2e"
format_stamp: "Formatted at 2026-08-08 07:07:17 on dist-test-slave-77v9"
server_key: "6410079f041263334334c68b2389c658"
server_key_iv: "684592b96e11e46f6500753ea3cccf50"
server_key_version: "encryptionkey@0"
I20260808 07:07:17.404865 13874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "d130d2b6f9a94198bf6de401ffcc0f2e"
format_stamp: "Formatted at 2026-08-08 07:07:17 on dist-test-slave-77v9"
server_key: "6410079f041263334334c68b2389c658"
server_key_iv: "684592b96e11e46f6500753ea3cccf50"
server_key_version: "encryptionkey@0"
I20260808 07:07:17.406327 13874 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:17.407538 13889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:17.407886 13874 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:17.408021 13874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "d130d2b6f9a94198bf6de401ffcc0f2e"
format_stamp: "Formatted at 2026-08-08 07:07:17 on dist-test-slave-77v9"
server_key: "6410079f041263334334c68b2389c658"
server_key_iv: "684592b96e11e46f6500753ea3cccf50"
server_key_version: "encryptionkey@0"
I20260808 07:07:17.408119 13874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:17.439827 13874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:17.442396 13874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:17.442579 13874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:17.442862 13874 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:17.443228 13874 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:17.443295 13874 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:17.443367 13874 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:17.443416 13874 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:17.450448 13874 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:41597
I20260808 07:07:17.450526 14003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:41597 every 8 connection(s)
I20260808 07:07:17.450838 13874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:07:17.453523 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 13874
I20260808 07:07:17.453662 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:17.453963 9592 external_mini_cluster.cc:1428] Setting key 4e3a2db52e384919691eeca109a3ec72
Aug 08 07:07:17 dist-test-slave-77v9 krb5kdc[13764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172837, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
I20260808 07:07:17.465381 13849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.451726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:57161 (local address 127.9.94.62:37523)
0808 07:07:17.451819 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:17.451822 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:17.452038 (+ 216us) server_negotiation.cc:407] Connection header received
0808 07:07:17.452587 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:17.452588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:17.452600 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:17.452685 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:17.454647 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.455316 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.456578 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.456931 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.457000 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.460446 (+ 3446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:17.460448 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:17.460449 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:17.460460 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:17.463209 (+ 2749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:17.463979 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:17.463980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:17.463981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:17.464089 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:17.464379 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:17.464380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:17.464380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:17.464592 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:17.464733 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:17.465169 (+ 436us) server_negotiation.cc:299] Negotiation successful
0808 07:07:17.465277 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 07:07:17.465631 14006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.451664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:37523 (local address 127.9.94.1:57161)
0808 07:07:17.451901 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:17.451941 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:17.452424 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:17.453067 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:17.453073 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:17.453513 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:17.454511 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.454522 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.455423 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.455424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.456463 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.456467 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.457033 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.457034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.457199 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.457938 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:17.457950 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:17.460265 (+ 2315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:17.463386 (+ 3121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:17.463403 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:17.463406 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:17.463847 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:17.464153 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:17.464154 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:17.464155 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:17.464293 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:17.464724 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:17.464733 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:17.464976 (+ 243us) client_negotiation.cc:769] Sending connection context
0808 07:07:17.465128 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 07:07:17.465366 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":102,"threads_started":1}
I20260808 07:07:17.466344 14004 heartbeater.cc:347] Connected to a master server at 127.9.94.62:37523
I20260808 07:07:17.466485 14004 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:17.466619 14004 heartbeater.cc:511] Master 127.9.94.62:37523 requested a full tablet report, sending...
I20260808 07:07:17.467374 13809 ts_manager.cc:194] Registered new tserver with Master: d130d2b6f9a94198bf6de401ffcc0f2e (127.9.94.1:41597)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
I20260808 07:07:17.468343 13809 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:57161
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:07:17.488631 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37523
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:17.586828 14009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:17.587119 14009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:17.587154 14009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:17.588613 14009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:17.588680 14009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:17.588716 14009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:17.590610 14009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37523
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:17.591132 14009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:17.591637 14009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:17.598636 14016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:17.598649 14018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:17.598637 14015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:17.599082 14009 server_base.cc:1034] running on GCE node
I20260808 07:07:17.599378 14009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:17.599690 14009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:17.600978 14009 hybrid_clock.cc:648] HybridClock initialized: now 1786172837600994 us; error 61 us; skew 500 ppm
Aug 08 07:07:17 dist-test-slave-77v9 krb5kdc[13764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172837, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:17.604585 14009 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:07:17.605083 14009 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:17.605165 14009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:17.605333 14009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:17.606510 14009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "1f357240e79e468f80913fd8bde7b750"
format_stamp: "Formatted at 2026-08-08 07:07:17 on dist-test-slave-77v9"
server_key: "8ddacbcbe68ea55557c42ee4ca2af291"
server_key_iv: "5013c5a557c4a26dc4f800ada7f5bd3a"
server_key_version: "encryptionkey@0"
I20260808 07:07:17.606918 14009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "1f357240e79e468f80913fd8bde7b750"
format_stamp: "Formatted at 2026-08-08 07:07:17 on dist-test-slave-77v9"
server_key: "8ddacbcbe68ea55557c42ee4ca2af291"
server_key_iv: "5013c5a557c4a26dc4f800ada7f5bd3a"
server_key_version: "encryptionkey@0"
I20260808 07:07:17.608577 14009 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:07:17.609793 14024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:17.610102 14009 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:17.610214 14009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "1f357240e79e468f80913fd8bde7b750"
format_stamp: "Formatted at 2026-08-08 07:07:17 on dist-test-slave-77v9"
server_key: "8ddacbcbe68ea55557c42ee4ca2af291"
server_key_iv: "5013c5a557c4a26dc4f800ada7f5bd3a"
server_key_version: "encryptionkey@0"
I20260808 07:07:17.610332 14009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:17.635190 14009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:17.638101 14009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:17.638240 14009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:17.638435 14009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:17.638811 14009 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:17.638888 14009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:17.638938 14009 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:17.638967 14009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:17.646659 14009 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:44007
I20260808 07:07:17.646770 14143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:44007 every 8 connection(s)
I20260808 07:07:17.647055 14009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:07:17 dist-test-slave-77v9 krb5kdc[13764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172837, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:17.656023 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 14009
I20260808 07:07:17.656177 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:07:17.656445 9592 external_mini_cluster.cc:1428] Setting key a7f0e1e1cca48f7f7dee04cee000d8bb
I20260808 07:07:17.659255 13849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.648155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:50733 (local address 127.9.94.62:37523)
0808 07:07:17.648282 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:17.648286 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:17.648595 (+ 309us) server_negotiation.cc:407] Connection header received
0808 07:07:17.649548 (+ 953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:17.649550 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:17.649569 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:17.649825 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:17.650931 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.651440 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.652489 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.652681 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.653036 (+ 355us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.655689 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:17.655690 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:17.655691 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:17.655700 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:17.657761 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:17.658216 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:17.658217 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:17.658218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:17.658282 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:17.658558 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:17.658559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:17.658559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:17.658686 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:17.658762 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:17.659067 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 07:07:17.659158 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 07:07:17.659480 14146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.648018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:37523 (local address 127.9.94.2:50733)
0808 07:07:17.648355 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:17.648437 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:17.649373 (+ 936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:17.649931 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:17.649937 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:17.650276 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:17.650810 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.650815 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.651546 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.651547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.652377 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.652379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.653048 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.653049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.653190 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.653845 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:17.653855 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:17.655565 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:17.657861 (+ 2296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:17.657870 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:17.657873 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:17.658117 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:17.658375 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:17.658376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:17.658376 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:17.658490 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:17.658763 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:17.658770 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:17.658926 (+ 156us) client_negotiation.cc:769] Sending connection context
0808 07:07:17.659034 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 07:07:17.659211 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":129,"threads_started":1}
I20260808 07:07:17.660104 14144 heartbeater.cc:347] Connected to a master server at 127.9.94.62:37523
I20260808 07:07:17.660205 14144 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:17.660401 14144 heartbeater.cc:511] Master 127.9.94.62:37523 requested a full tablet report, sending...
I20260808 07:07:17.660961 13809 ts_manager.cc:194] Registered new tserver with Master: 1f357240e79e468f80913fd8bde7b750 (127.9.94.2:44007)
I20260808 07:07:17.661396 13809 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:50733
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:07:17.694811 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37523
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:17.797868 14149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:17.798103 14149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:17.798132 14149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:17.799476 14149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:17.799531 14149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:17.799561 14149 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:17.801299 14149 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37523
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:17.801594 14149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:17.801863 14149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:17.807624 14155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:17.807617 14154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:17.807617 14157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:17.808125 14149 server_base.cc:1034] running on GCE node
I20260808 07:07:17.808395 14149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:17.809015 14149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:17.810221 14149 hybrid_clock.cc:648] HybridClock initialized: now 1786172837810193 us; error 72 us; skew 500 ppm
Aug 08 07:07:17 dist-test-slave-77v9 krb5kdc[13764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172837, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:17.813491 14149 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:07:17.813917 14149 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:17.814010 14149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:17.814244 14149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:17.815577 14149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4"
format_stamp: "Formatted at 2026-08-08 07:07:17 on dist-test-slave-77v9"
server_key: "963f4da58b8c21644419c797b4ab2f65"
server_key_iv: "5709fc9579a6b5461b69b6182df9d8c4"
server_key_version: "encryptionkey@0"
I20260808 07:07:17.816000 14149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4"
format_stamp: "Formatted at 2026-08-08 07:07:17 on dist-test-slave-77v9"
server_key: "963f4da58b8c21644419c797b4ab2f65"
server_key_iv: "5709fc9579a6b5461b69b6182df9d8c4"
server_key_version: "encryptionkey@0"
I20260808 07:07:17.817916 14149 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260808 07:07:17.818935 14163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:17.819152 14149 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:17.819274 14149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4"
format_stamp: "Formatted at 2026-08-08 07:07:17 on dist-test-slave-77v9"
server_key: "963f4da58b8c21644419c797b4ab2f65"
server_key_iv: "5709fc9579a6b5461b69b6182df9d8c4"
server_key_version: "encryptionkey@0"
I20260808 07:07:17.819365 14149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:17.830246 14149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:17.833712 14149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:17.833914 14149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:17.834208 14149 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:17.834605 14149 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:17.834666 14149 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:17.834715 14149 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:17.834767 14149 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:17.841560 14149 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:40381
I20260808 07:07:17.841601 14282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:40381 every 8 connection(s)
I20260808 07:07:17.841910 14149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:07:17.842993 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 14149
I20260808 07:07:17.843129 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:07:17.843346 9592 external_mini_cluster.cc:1428] Setting key bc15678fa1a60b4e6e33edbd9e81054f
Aug 08 07:07:17 dist-test-slave-77v9 krb5kdc[13764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172837, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:17.852730 13849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.842727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:58767 (local address 127.9.94.62:37523)
0808 07:07:17.842817 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:17.842820 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:17.843020 (+ 200us) server_negotiation.cc:407] Connection header received
0808 07:07:17.843741 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:17.843742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:17.843756 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:17.843839 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:17.845088 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.845608 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.846658 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.846889 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.846968 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.849555 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:17.849556 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:17.849556 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:17.849563 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:17.851221 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:17.851643 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:17.851644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:17.851645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:17.851703 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:17.852009 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:17.852010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:17.852010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:17.852127 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:17.852187 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:17.852573 (+ 386us) server_negotiation.cc:299] Negotiation successful
0808 07:07:17.852653 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 07:07:17.852977 14285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.842691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:37523 (local address 127.9.94.3:58767)
0808 07:07:17.842889 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:17.842934 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:17.843621 (+ 687us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:17.843949 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:17.843959 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:17.844387 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:17.845005 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.845010 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.845714 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.845715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.846559 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.846561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.847028 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.847029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.847146 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.847740 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:17.847750 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:17.849425 (+ 1675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:17.851320 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:17.851327 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:17.851329 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:17.851565 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:17.851793 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:17.851794 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:17.851794 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:17.851932 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:17.852245 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:17.852252 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:17.852401 (+ 149us) client_negotiation.cc:769] Sending connection context
0808 07:07:17.852512 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 07:07:17.852651 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":113,"threads_started":1}
I20260808 07:07:17.853590 14283 heartbeater.cc:347] Connected to a master server at 127.9.94.62:37523
I20260808 07:07:17.853709 14283 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:17.853853 14283 heartbeater.cc:511] Master 127.9.94.62:37523 requested a full tablet report, sending...
I20260808 07:07:17.854314 13809 ts_manager.cc:194] Registered new tserver with Master: c2fa35d8d2aa43259002c5f78ee1b6b4 (127.9.94.3:40381)
I20260808 07:07:17.854843 13809 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:58767
I20260808 07:07:17.855278 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:07:17.863687 13849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.856936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34580 (local address 127.9.94.62:37523)
0808 07:07:17.857023 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:17.857025 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:17.857051 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:07:17.857068 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:17.857069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:17.857077 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:17.857120 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:17.857715 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.858230 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.859032 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.859216 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.859282 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.860674 (+ 1392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:17.860676 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:17.860676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:17.860683 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:17.862248 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:17.862613 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:17.862614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:17.862614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:17.862677 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:17.862965 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:17.862966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:17.862966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:17.863160 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:17.863259 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:17.863534 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 07:07:17.863612 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 07:07:17.865885 13809 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34580:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:07:17.867527 13809 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:17.875166 14294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.870714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:41597 (local address 127.0.0.1:48246)
0808 07:07:17.871064 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:17.871104 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:17.871205 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:17.871582 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:17.871586 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:17.871588 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:17.871665 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.871667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.873001 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.873002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.874109 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.874111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.874848 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.874849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.874929 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.874948 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 07:07:17.875013 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 07:07:17.875075 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":59,"threads_started":1}
I20260808 07:07:17.875180 14296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.870846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48246 (local address 127.9.94.1:41597)
0808 07:07:17.871036 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:17.871042 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:17.871182 (+ 140us) server_negotiation.cc:407] Connection header received
0808 07:07:17.871293 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:17.871295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:17.871310 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:17.871484 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:17.871747 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.872894 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.874201 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.874764 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.874847 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.874909 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:17.875050 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 07:07:17.875092 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":117,"threads_started":1}
I20260808 07:07:17.875694 14297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.870717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:44007 (local address 127.0.0.1:60848)
0808 07:07:17.871827 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:17.871844 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:17.871915 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:17.872106 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:17.872107 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:17.872109 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:17.872176 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.872178 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.873408 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.873408 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.874584 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.874587 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.875464 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.875465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.875523 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.875526 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:17.875574 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 07:07:17.875613 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1093,"mutex_wait_us":2,"spinlock_wait_cycles":896,"thread_start_us":273,"threads_started":1}
I20260808 07:07:17.875731 14298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.871249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60848 (local address 127.9.94.2:44007)
0808 07:07:17.871773 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:17.871777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:17.871911 (+ 134us) server_negotiation.cc:407] Connection header received
0808 07:07:17.871988 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:17.871991 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:17.872006 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:17.872108 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:17.872241 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.873250 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.874688 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.875395 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.875465 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.875514 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:17.875584 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 07:07:17.875625 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":273,"threads_started":1}
I20260808 07:07:17.876351 14073 tablet_service.cc:1467] Processing CreateTablet for tablet 8b3d440a652e4cfa8dbc3ccb2a6f8a04 (DEFAULT_TABLE table=test-table [id=1bd36602c8354bc09311051605971c35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:17.876323 13937 tablet_service.cc:1467] Processing CreateTablet for tablet 8b3d440a652e4cfa8dbc3ccb2a6f8a04 (DEFAULT_TABLE table=test-table [id=1bd36602c8354bc09311051605971c35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:17.876471 14295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.870717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:40381 (local address 127.0.0.1:41686)
0808 07:07:17.871631 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:17.871645 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:17.871726 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:17.872060 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:17.872061 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:17.872064 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:17.872114 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.872115 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.873684 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.873685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.874903 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.874905 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.876246 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.876247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.876314 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.876318 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:17.876367 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:07:17.876405 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":888,"thread_start_us":236,"threads_started":1}
I20260808 07:07:17.876725 14299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.871230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41686 (local address 127.9.94.3:40381)
0808 07:07:17.871658 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:17.871665 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:17.871708 (+ 43us) server_negotiation.cc:407] Connection header received
0808 07:07:17.871811 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:17.871814 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:17.871831 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:17.871975 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:17.872191 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.873244 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.874981 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.876100 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.876161 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.876210 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:17.876580 (+ 370us) server_negotiation.cc:299] Negotiation successful
0808 07:07:17.876627 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":289,"threads_started":1}
I20260808 07:07:17.876744 13937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b3d440a652e4cfa8dbc3ccb2a6f8a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:17.876741 14073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b3d440a652e4cfa8dbc3ccb2a6f8a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:17.879776 14301 tablet_bootstrap.cc:492] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e: Bootstrap starting.
I20260808 07:07:17.880231 14214 tablet_service.cc:1467] Processing CreateTablet for tablet 8b3d440a652e4cfa8dbc3ccb2a6f8a04 (DEFAULT_TABLE table=test-table [id=1bd36602c8354bc09311051605971c35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:17.880645 14301 tablet_bootstrap.cc:654] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:17.880800 14214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b3d440a652e4cfa8dbc3ccb2a6f8a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:17.881028 14300 tablet_bootstrap.cc:492] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750: Bootstrap starting.
I20260808 07:07:17.881623 14300 tablet_bootstrap.cc:654] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:17.881667 14301 log.cc:824] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:17.882278 14300 log.cc:824] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:17.882658 14301 tablet_bootstrap.cc:492] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e: No bootstrap required, opened a new log
I20260808 07:07:17.882751 14301 ts_tablet_manager.cc:1397] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 07:07:17.884183 14301 raft_consensus.cc:348] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40381 } } peers { permanent_uuid: "1f357240e79e468f80913fd8bde7b750" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44007 } } peers { permanent_uuid: "d130d2b6f9a94198bf6de401ffcc0f2e" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 41597 } }
I20260808 07:07:17.884361 14301 raft_consensus.cc:374] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:17.884407 14301 raft_consensus.cc:729] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d130d2b6f9a94198bf6de401ffcc0f2e, State: Initialized, Role: FOLLOWER
I20260808 07:07:17.884480 14304 tablet_bootstrap.cc:492] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4: Bootstrap starting.
I20260808 07:07:17.884519 14301 consensus_queue.cc:260] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40381 } } peers { permanent_uuid: "1f357240e79e468f80913fd8bde7b750" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44007 } } peers { permanent_uuid: "d130d2b6f9a94198bf6de401ffcc0f2e" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 41597 } }
I20260808 07:07:17.884817 14301 ts_tablet_manager.cc:1428] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:07:17.884856 14004 heartbeater.cc:503] Master 127.9.94.62:37523 was elected leader, sending a full tablet report...
I20260808 07:07:17.885288 14304 tablet_bootstrap.cc:654] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:17.885675 14300 tablet_bootstrap.cc:492] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750: No bootstrap required, opened a new log
I20260808 07:07:17.885771 14300 ts_tablet_manager.cc:1397] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260808 07:07:17.885962 14304 log.cc:824] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:17.886896 14304 tablet_bootstrap.cc:492] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4: No bootstrap required, opened a new log
I20260808 07:07:17.886976 14304 ts_tablet_manager.cc:1397] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 07:07:17.887364 14300 raft_consensus.cc:348] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40381 } } peers { permanent_uuid: "1f357240e79e468f80913fd8bde7b750" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44007 } } peers { permanent_uuid: "d130d2b6f9a94198bf6de401ffcc0f2e" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 41597 } }
I20260808 07:07:17.887496 14300 raft_consensus.cc:374] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:17.887518 14300 raft_consensus.cc:729] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f357240e79e468f80913fd8bde7b750, State: Initialized, Role: FOLLOWER
I20260808 07:07:17.887635 14300 consensus_queue.cc:260] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40381 } } peers { permanent_uuid: "1f357240e79e468f80913fd8bde7b750" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44007 } } peers { permanent_uuid: "d130d2b6f9a94198bf6de401ffcc0f2e" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 41597 } }
I20260808 07:07:17.887928 14300 ts_tablet_manager.cc:1428] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:07:17.887960 14144 heartbeater.cc:503] Master 127.9.94.62:37523 was elected leader, sending a full tablet report...
I20260808 07:07:17.889225 14304 raft_consensus.cc:348] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40381 } } peers { permanent_uuid: "1f357240e79e468f80913fd8bde7b750" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44007 } } peers { permanent_uuid: "d130d2b6f9a94198bf6de401ffcc0f2e" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 41597 } }
I20260808 07:07:17.889421 14304 raft_consensus.cc:374] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:17.889469 14304 raft_consensus.cc:729] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2fa35d8d2aa43259002c5f78ee1b6b4, State: Initialized, Role: FOLLOWER
I20260808 07:07:17.889609 14304 consensus_queue.cc:260] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40381 } } peers { permanent_uuid: "1f357240e79e468f80913fd8bde7b750" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44007 } } peers { permanent_uuid: "d130d2b6f9a94198bf6de401ffcc0f2e" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 41597 } }
I20260808 07:07:17.889868 14304 ts_tablet_manager.cc:1428] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260808 07:07:17.889966 14283 heartbeater.cc:503] Master 127.9.94.62:37523 was elected leader, sending a full tablet report...
W20260808 07:07:17.897727 14145 tablet.cc:2369] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:07:17.932624 14305 raft_consensus.cc:482] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:17.932766 14305 raft_consensus.cc:504] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40381 } } peers { permanent_uuid: "1f357240e79e468f80913fd8bde7b750" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44007 } } peers { permanent_uuid: "d130d2b6f9a94198bf6de401ffcc0f2e" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 41597 } }
I20260808 07:07:17.933301 14305 leader_election.cc:288] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2fa35d8d2aa43259002c5f78ee1b6b4 (127.9.94.3:40381), 1f357240e79e468f80913fd8bde7b750 (127.9.94.2:44007)
I20260808 07:07:17.938513 14298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.933654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:55115 (local address 127.9.94.2:44007)
0808 07:07:17.933727 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:17.933728 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:17.933787 (+ 59us) server_negotiation.cc:407] Connection header received
0808 07:07:17.933851 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:17.933852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:17.933865 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:17.933928 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:17.934114 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.934904 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.936797 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.937931 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.938019 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.938028 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:17.938390 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 07:07:17.938437 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 07:07:17.938513 14299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.933893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:34749 (local address 127.9.94.3:40381)
0808 07:07:17.933938 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:17.933940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:17.934059 (+ 119us) server_negotiation.cc:407] Connection header received
0808 07:07:17.934105 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:17.934107 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:17.934119 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:17.934182 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:17.934330 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.935005 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.936797 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.937766 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.937874 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.937890 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:17.938390 (+ 500us) server_negotiation.cc:299] Negotiation successful
0808 07:07:17.938437 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:07:17.938537 14006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.933513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:44007 (local address 127.9.94.1:55115)
0808 07:07:17.933701 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:17.933717 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:17.933787 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:17.933966 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:17.933967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:17.933969 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:17.934033 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.934035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.935217 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.935218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.936663 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.936666 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.938205 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.938206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.938272 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.938274 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:07:17.938348 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 07:07:17.938408 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":39}
I20260808 07:07:17.938544 14309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.933800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:40381 (local address 127.9.94.1:34749)
0808 07:07:17.933973 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:17.933984 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:17.934044 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:17.934195 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:17.934196 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:17.934197 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:17.934253 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.934254 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.935105 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.935106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.936663 (+ 1557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:17.936666 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.938035 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.938038 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:17.938259 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.938268 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 07:07:17.938348 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 07:07:17.938408 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":67,"thread_start_us":95,"threads_started":1}
I20260808 07:07:17.939042 14096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b3d440a652e4cfa8dbc3ccb2a6f8a04" candidate_uuid: "d130d2b6f9a94198bf6de401ffcc0f2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f357240e79e468f80913fd8bde7b750" is_pre_election: true
I20260808 07:07:17.939244 14096 raft_consensus.cc:2454] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d130d2b6f9a94198bf6de401ffcc0f2e in term 0.
I20260808 07:07:17.939201 14235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b3d440a652e4cfa8dbc3ccb2a6f8a04" candidate_uuid: "d130d2b6f9a94198bf6de401ffcc0f2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4" is_pre_election: true
I20260808 07:07:17.939373 14235 raft_consensus.cc:2454] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d130d2b6f9a94198bf6de401ffcc0f2e in term 0.
I20260808 07:07:17.939549 13891 leader_election.cc:302] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f357240e79e468f80913fd8bde7b750, d130d2b6f9a94198bf6de401ffcc0f2e; no voters:
I20260808 07:07:17.939832 14305 raft_consensus.cc:2781] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:17.939913 14305 raft_consensus.cc:482] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:17.939944 14305 raft_consensus.cc:3037] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:17.940794 14305 raft_consensus.cc:504] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40381 } } peers { permanent_uuid: "1f357240e79e468f80913fd8bde7b750" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44007 } } peers { permanent_uuid: "d130d2b6f9a94198bf6de401ffcc0f2e" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 41597 } }
I20260808 07:07:17.941036 14305 leader_election.cc:288] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [CANDIDATE]: Term 1 election: Requested vote from peers c2fa35d8d2aa43259002c5f78ee1b6b4 (127.9.94.3:40381), 1f357240e79e468f80913fd8bde7b750 (127.9.94.2:44007)
I20260808 07:07:17.941179 14235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b3d440a652e4cfa8dbc3ccb2a6f8a04" candidate_uuid: "d130d2b6f9a94198bf6de401ffcc0f2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4"
I20260808 07:07:17.941256 14096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b3d440a652e4cfa8dbc3ccb2a6f8a04" candidate_uuid: "d130d2b6f9a94198bf6de401ffcc0f2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f357240e79e468f80913fd8bde7b750"
I20260808 07:07:17.941283 14235 raft_consensus.cc:3037] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:17.941363 14096 raft_consensus.cc:3037] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:17.942073 14235 raft_consensus.cc:2454] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d130d2b6f9a94198bf6de401ffcc0f2e in term 1.
I20260808 07:07:17.942317 13893 leader_election.cc:302] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c2fa35d8d2aa43259002c5f78ee1b6b4, d130d2b6f9a94198bf6de401ffcc0f2e; no voters:
I20260808 07:07:17.942363 14096 raft_consensus.cc:2454] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d130d2b6f9a94198bf6de401ffcc0f2e in term 1.
I20260808 07:07:17.942431 14305 raft_consensus.cc:2781] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:17.942617 14305 raft_consensus.cc:686] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [term 1 LEADER]: Becoming Leader. State: Replica: d130d2b6f9a94198bf6de401ffcc0f2e, State: Running, Role: LEADER
I20260808 07:07:17.942740 14305 consensus_queue.cc:237] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40381 } } peers { permanent_uuid: "1f357240e79e468f80913fd8bde7b750" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44007 } } peers { permanent_uuid: "d130d2b6f9a94198bf6de401ffcc0f2e" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 41597 } }
I20260808 07:07:17.943708 13809 catalog_manager.cc:5495] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d130d2b6f9a94198bf6de401ffcc0f2e (127.9.94.1). New cstate: current_term: 1 leader_uuid: "d130d2b6f9a94198bf6de401ffcc0f2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f357240e79e468f80913fd8bde7b750" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d130d2b6f9a94198bf6de401ffcc0f2e" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 41597 } health_report { overall_health: HEALTHY } } }
I20260808 07:07:17.951357 14296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.948426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48258 (local address 127.9.94.1:41597)
0808 07:07:17.948487 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:17.948489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:17.948504 (+ 15us) server_negotiation.cc:407] Connection header received
0808 07:07:17.948538 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:17.948538 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:17.948557 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:17.948637 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:17.948852 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.949371 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.950415 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:17.950633 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:17.950718 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:17.950957 (+ 239us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:17.951069 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:17.951177 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:17.951207 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 07:07:17.951230 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 07:07:17.951624 14005 tablet.cc:2369] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:07:17.953559 14096 raft_consensus.cc:1261] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750 [term 1 FOLLOWER]: Refusing update from remote peer d130d2b6f9a94198bf6de401ffcc0f2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:17.953706 14235 raft_consensus.cc:1261] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4 [term 1 FOLLOWER]: Refusing update from remote peer d130d2b6f9a94198bf6de401ffcc0f2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:17.954275 14310 consensus_queue.cc:1035] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f357240e79e468f80913fd8bde7b750" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:17.954476 14305 consensus_queue.cc:1035] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2fa35d8d2aa43259002c5f78ee1b6b4" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:17.957777 14315 mvcc.cc:205] Tried to move back new op lower bound from 7316163944253767680 to 7316163944214421504. Current Snapshot: MvccSnapshot[applied={T|T < 7316163944253767680}]
I20260808 07:07:17.958045 14314 mvcc.cc:205] Tried to move back new op lower bound from 7316163944253767680 to 7316163944214421504. Current Snapshot: MvccSnapshot[applied={T|T < 7316163944253767680}]
I20260808 07:07:17.959924 13809 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:17.960026 13809 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:17.960853 13809 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f65f5b5b0a27480aaf300d612723423e: Sending DeleteTablet for 3 replicas of tablet 8b3d440a652e4cfa8dbc3ccb2a6f8a04
I20260808 07:07:17.961525 13937 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b3d440a652e4cfa8dbc3ccb2a6f8a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:17 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:48246
I20260808 07:07:17.961678 14214 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b3d440a652e4cfa8dbc3ccb2a6f8a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:17 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:41686
I20260808 07:07:17.961864 14323 tablet_replica.cc:330] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e: stopping tablet replica
I20260808 07:07:17.962132 14323 raft_consensus.cc:2229] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:07:17.962175 14073 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b3d440a652e4cfa8dbc3ccb2a6f8a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:17 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:60848
I20260808 07:07:17.962227 14324 tablet_replica.cc:330] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4: stopping tablet replica
I20260808 07:07:17.962303 14323 raft_consensus.cc:2258] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P d130d2b6f9a94198bf6de401ffcc0f2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:17.962344 14324 raft_consensus.cc:2229] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:17.962445 14324 raft_consensus.cc:2258] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:17.962586 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 13874
I20260808 07:07:17.962955 14324 ts_tablet_manager.cc:1905] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:17.965176 14324 ts_tablet_manager.cc:1918] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:17.965252 14324 log.cc:1196] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/8b3d440a652e4cfa8dbc3ccb2a6f8a04
I20260808 07:07:17.965617 14324 ts_tablet_manager.cc:1939] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P c2fa35d8d2aa43259002c5f78ee1b6b4: Deleting consensus metadata
I20260808 07:07:17.966101 13796 catalog_manager.cc:4841] TS c2fa35d8d2aa43259002c5f78ee1b6b4 (127.9.94.3:40381): tablet 8b3d440a652e4cfa8dbc3ccb2a6f8a04 (table test-table [id=1bd36602c8354bc09311051605971c35]) successfully deleted
I20260808 07:07:17.966503 14325 tablet_replica.cc:330] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750: stopping tablet replica
I20260808 07:07:17.966652 14325 raft_consensus.cc:2229] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:17.966785 14325 raft_consensus.cc:2258] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:17.967202 14325 ts_tablet_manager.cc:1905] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:17.969019 14325 ts_tablet_manager.cc:1918] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:17.969116 14325 log.cc:1196] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/8b3d440a652e4cfa8dbc3ccb2a6f8a04
I20260808 07:07:17.969439 14325 ts_tablet_manager.cc:1939] T 8b3d440a652e4cfa8dbc3ccb2a6f8a04 P 1f357240e79e468f80913fd8bde7b750: Deleting consensus metadata
I20260808 07:07:17.969983 13794 catalog_manager.cc:4841] TS 1f357240e79e468f80913fd8bde7b750 (127.9.94.2:44007): tablet 8b3d440a652e4cfa8dbc3ccb2a6f8a04 (table test-table [id=1bd36602c8354bc09311051605971c35]) successfully deleted
W20260808 07:07:17.970983 13793 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:41597 (error 108)
I20260808 07:07:17.971249 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 14009
I20260808 07:07:17.975301 14295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:17.975061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:41597 (local address 127.0.0.1:48268)
0808 07:07:17.975160 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:17.975262 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:41597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260808 07:07:17.975482 13793 catalog_manager.cc:4584] TS d130d2b6f9a94198bf6de401ffcc0f2e (127.9.94.1:41597): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8b3d440a652e4cfa8dbc3ccb2a6f8a04: Network error: Client connection negotiation failed: client connection to 127.9.94.1:41597: connect: Connection refused (error 111)
I20260808 07:07:17.979140 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 14149
I20260808 07:07:17.986083 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 13778
2026-08-08T07:07:17Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2275 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T07:07:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:18Z Disabled control of system clock
I20260808 07:07:18.019766 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:43201
--webserver_interface=127.9.94.62
--webserver_port=0
--builtin_ntp_servers=127.9.94.20:43383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:43201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 07:07:18.117558 14330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:18.117792 14330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:18.117815 14330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:18.119091 14330 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:18.119144 14330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:18.119158 14330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:18.119170 14330 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:18.119184 14330 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:18.120649 14330 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:43201
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:43201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:18.120960 14330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:18.121331 14330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:18.126881 14336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:18.126870 14338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:18.126886 14335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:18.127242 14330 server_base.cc:1034] running on GCE node
I20260808 07:07:18.127540 14330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:18.127825 14330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:18.128981 14330 hybrid_clock.cc:648] HybridClock initialized: now 1786172838128962 us; error 46 us; skew 500 ppm
I20260808 07:07:18.130411 14330 webserver.cc:460] Webserver started at http://127.9.94.62:41475/ using document root <none> and password file <none>
I20260808 07:07:18.130689 14330 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:18.130738 14330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:18.130838 14330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:18.131918 14330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "3b5f46ed964a485199205ba2fdde3ca2"
format_stamp: "Formatted at 2026-08-08 07:07:18 on dist-test-slave-77v9"
server_key: "b7a3389c0c2e1de4eddebc4ac47156f0"
server_key_iv: "7b884fcdf265b4cc37de6c5e372172be"
server_key_version: "encryptionkey@0"
I20260808 07:07:18.132241 14330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "3b5f46ed964a485199205ba2fdde3ca2"
format_stamp: "Formatted at 2026-08-08 07:07:18 on dist-test-slave-77v9"
server_key: "b7a3389c0c2e1de4eddebc4ac47156f0"
server_key_iv: "7b884fcdf265b4cc37de6c5e372172be"
server_key_version: "encryptionkey@0"
I20260808 07:07:18.133826 14330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:07:18.134963 14344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:18.135179 14330 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:18.135282 14330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "3b5f46ed964a485199205ba2fdde3ca2"
format_stamp: "Formatted at 2026-08-08 07:07:18 on dist-test-slave-77v9"
server_key: "b7a3389c0c2e1de4eddebc4ac47156f0"
server_key_iv: "7b884fcdf265b4cc37de6c5e372172be"
server_key_version: "encryptionkey@0"
I20260808 07:07:18.135360 14330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:18.139340 14330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:18.139673 14330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:18.139833 14330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:18.144490 14330 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:43201
I20260808 07:07:18.144606 14398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:43201 every 8 connection(s)
I20260808 07:07:18.145009 14330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:18.145879 14399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:18.147209 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 14330
I20260808 07:07:18.147311 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:18.147564 9592 external_mini_cluster.cc:1428] Setting key 9d8912b6260437cec7f49660ee5b7cda
I20260808 07:07:18.150188 14399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2: Bootstrap starting.
I20260808 07:07:18.150801 14402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.148258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41392 (local address 127.9.94.62:43201)
0808 07:07:18.148554 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:18.148564 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:18.148597 (+ 33us) server_negotiation.cc:407] Connection header received
0808 07:07:18.149255 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:18.149265 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:18.149328 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:18.149495 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:18.150280 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:18.150285 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:18.150285 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:18.150291 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:18.150342 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:18.150358 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:18.150443 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:18.150504 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 07:07:18.150566 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":80,"threads_started":1}
I20260808 07:07:18.151082 14399 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:18.151415 14399 log.cc:824] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:18.152220 14399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2: No bootstrap required, opened a new log
I20260808 07:07:18.153802 14399 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b5f46ed964a485199205ba2fdde3ca2" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43201 } }
I20260808 07:07:18.153959 14399 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:18.153986 14399 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b5f46ed964a485199205ba2fdde3ca2, State: Initialized, Role: FOLLOWER
I20260808 07:07:18.154129 14399 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b5f46ed964a485199205ba2fdde3ca2" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43201 } }
I20260808 07:07:18.154219 14399 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:18.154277 14399 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:18.154342 14399 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:18.154954 14399 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b5f46ed964a485199205ba2fdde3ca2" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43201 } }
I20260808 07:07:18.155086 14399 leader_election.cc:302] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b5f46ed964a485199205ba2fdde3ca2; no voters:
I20260808 07:07:18.155411 14399 leader_election.cc:288] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:18.155462 14405 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:18.155589 14405 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3b5f46ed964a485199205ba2fdde3ca2, State: Running, Role: LEADER
I20260808 07:07:18.155681 14405 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b5f46ed964a485199205ba2fdde3ca2" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43201 } }
I20260808 07:07:18.155747 14399 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:18.156021 14405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b5f46ed964a485199205ba2fdde3ca2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b5f46ed964a485199205ba2fdde3ca2" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43201 } } }
I20260808 07:07:18.156103 14405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:18.156219 14405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b5f46ed964a485199205ba2fdde3ca2. Latest consensus state: current_term: 1 leader_uuid: "3b5f46ed964a485199205ba2fdde3ca2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b5f46ed964a485199205ba2fdde3ca2" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43201 } } }
I20260808 07:07:18.156369 14405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:18.156541 14409 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:18.157083 14409 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:18.158900 14409 catalog_manager.cc:1347] Generated new cluster ID: 77ca3bbf1eaa421eb85ab0de92ae3b11
I20260808 07:07:18.158970 14409 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:18.181397 14409 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:18.181629 14409 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:18.187250 14409 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2: Generated new TSK 0
I20260808 07:07:18.187492 14409 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:07:18.192273 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:43201
--builtin_ntp_servers=127.9.94.20:43383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 07:07:18.291271 14425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:18.291563 14425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:18.291610 14425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:18.293087 14425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:18.293161 14425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:18.293213 14425 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:18.294816 14425 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:43201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:18.295157 14425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:18.295487 14425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:07:18.302456 14425 server_base.cc:1034] running on GCE node
W20260808 07:07:18.302371 14435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:18.302513 14432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:18.302361 14431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:18.302879 14425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:18.303188 14425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:18.304384 14425 hybrid_clock.cc:648] HybridClock initialized: now 1786172838304357 us; error 50 us; skew 500 ppm
I20260808 07:07:18.306162 14425 webserver.cc:460] Webserver started at http://127.9.94.1:43879/ using document root <none> and password file <none>
I20260808 07:07:18.306484 14425 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:18.306540 14425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:18.306739 14425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:18.308001 14425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "273e3580ded444e58c5354176e1fa2d2"
format_stamp: "Formatted at 2026-08-08 07:07:18 on dist-test-slave-77v9"
server_key: "6c6242bbc0c06eed1a830f596dab94eb"
server_key_iv: "5730432584a801047b3d4909cfeb6b92"
server_key_version: "encryptionkey@0"
I20260808 07:07:18.308423 14425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "273e3580ded444e58c5354176e1fa2d2"
format_stamp: "Formatted at 2026-08-08 07:07:18 on dist-test-slave-77v9"
server_key: "6c6242bbc0c06eed1a830f596dab94eb"
server_key_iv: "5730432584a801047b3d4909cfeb6b92"
server_key_version: "encryptionkey@0"
I20260808 07:07:18.310251 14425 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 07:07:18.311134 14441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:18.311396 14425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:18.311519 14425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "273e3580ded444e58c5354176e1fa2d2"
format_stamp: "Formatted at 2026-08-08 07:07:18 on dist-test-slave-77v9"
server_key: "6c6242bbc0c06eed1a830f596dab94eb"
server_key_iv: "5730432584a801047b3d4909cfeb6b92"
server_key_version: "encryptionkey@0"
I20260808 07:07:18.311609 14425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:18.315276 14425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:18.315567 14425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:18.315737 14425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:18.315973 14425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:18.316361 14425 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:18.316435 14425 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:18.316483 14425 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:18.316514 14425 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:18.323568 14425 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:43869
I20260808 07:07:18.323628 14557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:43869 every 8 connection(s)
I20260808 07:07:18.324030 14425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:07:18.327888 14402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.325085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:55901 (local address 127.9.94.62:43201)
0808 07:07:18.325177 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:18.325180 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:18.325220 (+ 40us) server_negotiation.cc:407] Connection header received
0808 07:07:18.325814 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:18.325817 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:18.325828 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:18.325940 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:18.327510 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:18.327512 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:18.327512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:18.327520 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:18.327542 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:18.327546 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:18.327619 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:18.327796 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 07:07:18.327813 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 07:07:18.328068 14560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.324802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:43201 (local address 127.9.94.1:55901)
0808 07:07:18.325079 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:18.325125 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:18.325617 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:18.326013 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:18.326016 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:18.326024 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:18.327272 (+ 1248us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:07:18.327272 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:18.327304 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:07:18.327335 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:18.327657 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:18.327664 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:18.327667 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:18.327750 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 07:07:18.327813 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":113,"threads_started":1}
I20260808 07:07:18.328744 14558 heartbeater.cc:347] Connected to a master server at 127.9.94.62:43201
I20260808 07:07:18.328893 14558 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:18.329083 14558 heartbeater.cc:511] Master 127.9.94.62:43201 requested a full tablet report, sending...
I20260808 07:07:18.329175 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 14425
I20260808 07:07:18.329310 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:18.329536 9592 external_mini_cluster.cc:1428] Setting key 46486891eaea44c730a925734781bec1
I20260808 07:07:18.329680 14363 ts_manager.cc:194] Registered new tserver with Master: 273e3580ded444e58c5354176e1fa2d2 (127.9.94.1:43869)
I20260808 07:07:18.330754 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:43201
--builtin_ntp_servers=127.9.94.20:43383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 07:07:18.421757 14561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:18.421993 14561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:18.422017 14561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:18.423139 14561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:18.423179 14561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:18.423206 14561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:18.424506 14561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:43201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:18.424705 14561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:18.425321 14561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:18.430735 14569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:18.430948 14561 server_base.cc:1034] running on GCE node
W20260808 07:07:18.430760 14566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:18.430778 14567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:18.431234 14561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:18.431540 14561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:18.432740 14561 hybrid_clock.cc:648] HybridClock initialized: now 1786172838432725 us; error 45 us; skew 500 ppm
I20260808 07:07:18.434259 14561 webserver.cc:460] Webserver started at http://127.9.94.2:35401/ using document root <none> and password file <none>
I20260808 07:07:18.434568 14561 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:18.434649 14561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:18.434811 14561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:18.435984 14561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "c6b6a75fce9644a8a4f51e4da95f00b9"
format_stamp: "Formatted at 2026-08-08 07:07:18 on dist-test-slave-77v9"
server_key: "0657836bfe5ca97c25719ccd96e52e62"
server_key_iv: "408e6c2fc82089c02e871ee161b9fd15"
server_key_version: "encryptionkey@0"
I20260808 07:07:18.436380 14561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "c6b6a75fce9644a8a4f51e4da95f00b9"
format_stamp: "Formatted at 2026-08-08 07:07:18 on dist-test-slave-77v9"
server_key: "0657836bfe5ca97c25719ccd96e52e62"
server_key_iv: "408e6c2fc82089c02e871ee161b9fd15"
server_key_version: "encryptionkey@0"
I20260808 07:07:18.437968 14561 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:07:18.439188 14575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:18.439534 14561 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:18.439646 14561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "c6b6a75fce9644a8a4f51e4da95f00b9"
format_stamp: "Formatted at 2026-08-08 07:07:18 on dist-test-slave-77v9"
server_key: "0657836bfe5ca97c25719ccd96e52e62"
server_key_iv: "408e6c2fc82089c02e871ee161b9fd15"
server_key_version: "encryptionkey@0"
I20260808 07:07:18.439710 14561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:18.443356 14561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:18.443594 14561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:18.443698 14561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:18.443874 14561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:18.444202 14561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:18.444238 14561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:18.444259 14561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:18.444272 14561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:18.450162 14561 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:45741
I20260808 07:07:18.450397 14692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:45741 every 8 connection(s)
I20260808 07:07:18.450609 14561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:07:18.454638 14402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.451638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:33271 (local address 127.9.94.62:43201)
0808 07:07:18.451716 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:18.451719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:18.452075 (+ 356us) server_negotiation.cc:407] Connection header received
0808 07:07:18.452626 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:18.452627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:18.452633 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:18.452700 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:18.454292 (+ 1592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:18.454293 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:18.454293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:18.454298 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:18.454338 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:18.454342 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:18.454404 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:18.454564 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 07:07:18.454579 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 07:07:18.454891 14695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.451645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:43201 (local address 127.9.94.2:33271)
0808 07:07:18.451931 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:18.451967 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:18.452473 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:18.453045 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:18.453048 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:18.453058 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:18.454113 (+ 1055us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:07:18.454114 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:18.454144 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:07:18.454173 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:18.454449 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:18.454455 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:18.454458 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:18.454540 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 07:07:18.454602 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":116,"threads_started":1}
I20260808 07:07:18.455531 14693 heartbeater.cc:347] Connected to a master server at 127.9.94.62:43201
I20260808 07:07:18.455767 14693 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:18.456028 14693 heartbeater.cc:511] Master 127.9.94.62:43201 requested a full tablet report, sending...
I20260808 07:07:18.456673 14362 ts_manager.cc:194] Registered new tserver with Master: c6b6a75fce9644a8a4f51e4da95f00b9 (127.9.94.2:45741)
I20260808 07:07:18.457350 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 14561
I20260808 07:07:18.457445 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:07:18.457650 9592 external_mini_cluster.cc:1428] Setting key 2c7da941d47683560f5bb6e7bccf0448
I20260808 07:07:18.458936 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:43201
--builtin_ntp_servers=127.9.94.20:43383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 07:07:18.554453 14696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:18.554751 14696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:18.554802 14696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:18.556318 14696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:18.556380 14696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:18.556425 14696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:18.558061 14696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:43201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:18.558372 14696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:18.558697 14696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:18.564527 14702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:18.564604 14696 server_base.cc:1034] running on GCE node
W20260808 07:07:18.564688 14705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:18.564688 14703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:18.565201 14696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:18.565510 14696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:18.566708 14696 hybrid_clock.cc:648] HybridClock initialized: now 1786172838566680 us; error 50 us; skew 500 ppm
I20260808 07:07:18.568267 14696 webserver.cc:460] Webserver started at http://127.9.94.3:40755/ using document root <none> and password file <none>
I20260808 07:07:18.568583 14696 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:18.568663 14696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:18.568864 14696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:18.570091 14696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "9306faec6b9a40079d0c71a632d66c29"
format_stamp: "Formatted at 2026-08-08 07:07:18 on dist-test-slave-77v9"
server_key: "ef0ad9a350cf2937895cd11d2f7c93d8"
server_key_iv: "5753fa7bb890dc5fbe0ba31c2c257271"
server_key_version: "encryptionkey@0"
I20260808 07:07:18.570528 14696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "9306faec6b9a40079d0c71a632d66c29"
format_stamp: "Formatted at 2026-08-08 07:07:18 on dist-test-slave-77v9"
server_key: "ef0ad9a350cf2937895cd11d2f7c93d8"
server_key_iv: "5753fa7bb890dc5fbe0ba31c2c257271"
server_key_version: "encryptionkey@0"
I20260808 07:07:18.572137 14696 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:07:18.573426 14711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:18.573799 14696 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:18.573983 14696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "9306faec6b9a40079d0c71a632d66c29"
format_stamp: "Formatted at 2026-08-08 07:07:18 on dist-test-slave-77v9"
server_key: "ef0ad9a350cf2937895cd11d2f7c93d8"
server_key_iv: "5753fa7bb890dc5fbe0ba31c2c257271"
server_key_version: "encryptionkey@0"
I20260808 07:07:18.574074 14696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:18.577863 14696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:18.578137 14696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:18.578282 14696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:18.578501 14696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:18.578832 14696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:18.578892 14696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:18.578935 14696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:18.578962 14696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:18.585278 14696 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:36875
I20260808 07:07:18.585319 14827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:36875 every 8 connection(s)
I20260808 07:07:18.585744 14696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:07:18.586323 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 14696
I20260808 07:07:18.586467 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:07:18.586720 9592 external_mini_cluster.cc:1428] Setting key c520f3897ae5031da376fb370556b9f2
I20260808 07:07:18.590370 14402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.586731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:48519 (local address 127.9.94.62:43201)
0808 07:07:18.586803 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:18.586806 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:18.587224 (+ 418us) server_negotiation.cc:407] Connection header received
0808 07:07:18.588370 (+ 1146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:18.588372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:18.588382 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:18.588459 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:18.590077 (+ 1618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:18.590078 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:18.590079 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:18.590085 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:18.590102 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:18.590107 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:18.590169 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:18.590276 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 07:07:18.590292 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 07:07:18.590606 14830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.586718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:43201 (local address 127.9.94.3:48519)
0808 07:07:18.586899 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:18.586942 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:18.588186 (+ 1244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:18.588712 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:18.588717 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:18.588727 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:18.589879 (+ 1152us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:07:18.589879 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:18.589912 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:07:18.589943 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:18.590175 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:18.590180 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:18.590184 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:18.590288 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 07:07:18.590356 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260808 07:07:18.591081 14828 heartbeater.cc:347] Connected to a master server at 127.9.94.62:43201
I20260808 07:07:18.591203 14828 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:18.591390 14828 heartbeater.cc:511] Master 127.9.94.62:43201 requested a full tablet report, sending...
I20260808 07:07:18.591835 14362 ts_manager.cc:194] Registered new tserver with Master: 9306faec6b9a40079d0c71a632d66c29 (127.9.94.3:36875)
I20260808 07:07:18.599057 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:07:18.601943 14402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.600727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41398 (local address 127.9.94.62:43201)
0808 07:07:18.600779 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:18.600781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:18.600791 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:07:18.600907 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:18.600908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:18.600919 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:18.600982 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:18.601669 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:18.601670 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:18.601670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:18.601685 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:18.601703 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:18.601712 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:18.601788 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:18.601840 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 07:07:18.601856 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:07:18.603885 14362 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41398:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:07:18.605751 14362 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:18.610515 14838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.608335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:45741 (local address 127.0.0.1:46888)
0808 07:07:18.608878 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:18.608889 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:18.608946 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:18.609264 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:18.609272 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:18.609279 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:18.609987 (+ 708us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:07:18.609987 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:18.610011 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:07:18.610040 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:18.610305 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:18.610325 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:18.610328 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:18.610406 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 07:07:18.610421 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":68,"threads_started":1}
I20260808 07:07:18.610580 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.608674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46888 (local address 127.9.94.2:45741)
0808 07:07:18.608875 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:18.608880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:18.608962 (+ 82us) server_negotiation.cc:407] Connection header received
0808 07:07:18.609019 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:18.609022 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:18.609031 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:18.609191 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:18.610136 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:18.610144 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:18.610144 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:18.610149 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:18.610186 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:18.610214 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:18.610276 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:18.610437 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 07:07:18.610456 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":108,"threads_started":1}
I20260808 07:07:18.610703 14839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.608487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36044 (local address 127.9.94.1:43869)
0808 07:07:18.609199 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:18.609203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:18.609213 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:07:18.609241 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:18.609244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:18.609253 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:18.609326 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:18.610351 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:18.610354 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:18.610355 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:18.610358 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:18.610389 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:18.610403 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:18.610459 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:18.610571 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 07:07:18.610587 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":199,"threads_started":1}
I20260808 07:07:18.610917 14841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.608775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36556 (local address 127.9.94.3:36875)
0808 07:07:18.608973 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:18.608977 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:18.609114 (+ 137us) server_negotiation.cc:407] Connection header received
0808 07:07:18.609142 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:18.609144 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:18.609154 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:18.609228 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:18.610334 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:18.610343 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:18.610343 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:18.610357 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:18.610412 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:18.610437 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:18.610734 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:18.610758 (+ 24us) server_negotiation.cc:299] Negotiation successful
0808 07:07:18.610775 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":119,"threads_started":1}
I20260808 07:07:18.610656 14836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.608569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:36875 (local address 127.0.0.1:36556)
0808 07:07:18.609019 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:18.609032 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:18.609064 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:18.609451 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:18.609452 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:18.609455 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:18.610210 (+ 755us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:07:18.610210 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:18.610218 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:07:18.610234 (+ 16us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:18.610520 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:18.610521 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:18.610522 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 07:07:18.610553 (+ 31us) client_negotiation.cc:240] Negotiation successful
0808 07:07:18.610577 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":79,"threads_started":1}
I20260808 07:07:18.611697 14626 tablet_service.cc:1467] Processing CreateTablet for tablet 3f63ac27c9d44d058992946b0bcef09e (DEFAULT_TABLE table=test-table [id=429d40c5ee704713841d0e46c722c90c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:18.611696 14761 tablet_service.cc:1467] Processing CreateTablet for tablet 3f63ac27c9d44d058992946b0bcef09e (DEFAULT_TABLE table=test-table [id=429d40c5ee704713841d0e46c722c90c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:18.612077 14626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f63ac27c9d44d058992946b0bcef09e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:18.612077 14761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f63ac27c9d44d058992946b0bcef09e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:18.610860 14837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.608335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:43869 (local address 127.0.0.1:36044)
0808 07:07:18.608525 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:18.608566 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:18.608624 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:18.609327 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:18.609328 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:18.609331 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:18.610210 (+ 879us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:07:18.610210 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:18.610218 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:07:18.610235 (+ 17us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:18.610484 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:18.610485 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:18.610486 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 07:07:18.610527 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 07:07:18.610540 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"spinlock_wait_cycles":384,"thread_start_us":112,"threads_started":1}
I20260808 07:07:18.615721 14842 tablet_bootstrap.cc:492] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29: Bootstrap starting.
I20260808 07:07:18.616562 14842 tablet_bootstrap.cc:654] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:18.616443 14490 tablet_service.cc:1467] Processing CreateTablet for tablet 3f63ac27c9d44d058992946b0bcef09e (DEFAULT_TABLE table=test-table [id=429d40c5ee704713841d0e46c722c90c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:18.616882 14490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f63ac27c9d44d058992946b0bcef09e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:18.616948 14842 log.cc:824] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:18.617311 14843 tablet_bootstrap.cc:492] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9: Bootstrap starting.
I20260808 07:07:18.617898 14843 tablet_bootstrap.cc:654] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:18.618186 14843 log.cc:824] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:18.618723 14842 tablet_bootstrap.cc:492] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29: No bootstrap required, opened a new log
I20260808 07:07:18.618803 14842 ts_tablet_manager.cc:1397] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:07:18.619006 14843 tablet_bootstrap.cc:492] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9: No bootstrap required, opened a new log
I20260808 07:07:18.619074 14843 ts_tablet_manager.cc:1397] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:07:18.620204 14846 tablet_bootstrap.cc:492] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2: Bootstrap starting.
I20260808 07:07:18.620783 14846 tablet_bootstrap.cc:654] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:18.621304 14846 log.cc:824] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:18.622292 14842 raft_consensus.cc:348] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "273e3580ded444e58c5354176e1fa2d2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43869 } } peers { permanent_uuid: "c6b6a75fce9644a8a4f51e4da95f00b9" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 45741 } } peers { permanent_uuid: "9306faec6b9a40079d0c71a632d66c29" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36875 } }
I20260808 07:07:18.622514 14842 raft_consensus.cc:374] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:18.622438 14843 raft_consensus.cc:348] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "273e3580ded444e58c5354176e1fa2d2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43869 } } peers { permanent_uuid: "c6b6a75fce9644a8a4f51e4da95f00b9" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 45741 } } peers { permanent_uuid: "9306faec6b9a40079d0c71a632d66c29" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36875 } }
I20260808 07:07:18.622557 14842 raft_consensus.cc:729] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9306faec6b9a40079d0c71a632d66c29, State: Initialized, Role: FOLLOWER
I20260808 07:07:18.622592 14843 raft_consensus.cc:374] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:18.622641 14843 raft_consensus.cc:729] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6b6a75fce9644a8a4f51e4da95f00b9, State: Initialized, Role: FOLLOWER
I20260808 07:07:18.622728 14842 consensus_queue.cc:260] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "273e3580ded444e58c5354176e1fa2d2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43869 } } peers { permanent_uuid: "c6b6a75fce9644a8a4f51e4da95f00b9" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 45741 } } peers { permanent_uuid: "9306faec6b9a40079d0c71a632d66c29" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36875 } }
I20260808 07:07:18.622761 14843 consensus_queue.cc:260] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "273e3580ded444e58c5354176e1fa2d2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43869 } } peers { permanent_uuid: "c6b6a75fce9644a8a4f51e4da95f00b9" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 45741 } } peers { permanent_uuid: "9306faec6b9a40079d0c71a632d66c29" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36875 } }
I20260808 07:07:18.623070 14843 ts_tablet_manager.cc:1428] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260808 07:07:18.623070 14842 ts_tablet_manager.cc:1428] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260808 07:07:18.623267 14693 heartbeater.cc:503] Master 127.9.94.62:43201 was elected leader, sending a full tablet report...
I20260808 07:07:18.623286 14828 heartbeater.cc:503] Master 127.9.94.62:43201 was elected leader, sending a full tablet report...
I20260808 07:07:18.624040 14846 tablet_bootstrap.cc:492] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2: No bootstrap required, opened a new log
I20260808 07:07:18.624151 14846 ts_tablet_manager.cc:1397] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 07:07:18.626283 14846 raft_consensus.cc:348] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "273e3580ded444e58c5354176e1fa2d2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43869 } } peers { permanent_uuid: "c6b6a75fce9644a8a4f51e4da95f00b9" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 45741 } } peers { permanent_uuid: "9306faec6b9a40079d0c71a632d66c29" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36875 } }
I20260808 07:07:18.626430 14846 raft_consensus.cc:374] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:18.626470 14846 raft_consensus.cc:729] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 273e3580ded444e58c5354176e1fa2d2, State: Initialized, Role: FOLLOWER
I20260808 07:07:18.626617 14846 consensus_queue.cc:260] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "273e3580ded444e58c5354176e1fa2d2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43869 } } peers { permanent_uuid: "c6b6a75fce9644a8a4f51e4da95f00b9" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 45741 } } peers { permanent_uuid: "9306faec6b9a40079d0c71a632d66c29" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36875 } }
I20260808 07:07:18.626927 14846 ts_tablet_manager.cc:1428] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:07:18.627136 14558 heartbeater.cc:503] Master 127.9.94.62:43201 was elected leader, sending a full tablet report...
I20260808 07:07:18.683357 14848 raft_consensus.cc:482] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:18.683547 14848 raft_consensus.cc:504] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "273e3580ded444e58c5354176e1fa2d2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43869 } } peers { permanent_uuid: "c6b6a75fce9644a8a4f51e4da95f00b9" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 45741 } } peers { permanent_uuid: "9306faec6b9a40079d0c71a632d66c29" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36875 } }
I20260808 07:07:18.684002 14848 leader_election.cc:288] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 273e3580ded444e58c5354176e1fa2d2 (127.9.94.1:43869), c6b6a75fce9644a8a4f51e4da95f00b9 (127.9.94.2:45741)
I20260808 07:07:18.685869 14830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.684239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:43869 (local address 127.9.94.3:40779)
0808 07:07:18.684307 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:18.684319 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:18.684362 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:18.684581 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:18.684582 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:18.684585 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:18.685317 (+ 732us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:07:18.685317 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:18.685322 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:07:18.685332 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:18.685595 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:18.685596 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:18.685597 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 07:07:18.685793 (+ 196us) client_negotiation.cc:240] Negotiation successful
0808 07:07:18.685803 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 07:07:18.685906 14851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.684239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:45741 (local address 127.9.94.3:52971)
0808 07:07:18.684468 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:18.684475 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:18.684515 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:18.684681 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:18.684682 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:18.684684 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:18.685250 (+ 566us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:07:18.685250 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:18.685258 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:07:18.685293 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:18.685595 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:18.685596 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:18.685597 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 07:07:18.685770 (+ 173us) client_negotiation.cc:240] Negotiation successful
0808 07:07:18.685787 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":25,"thread_start_us":111,"threads_started":1}
I20260808 07:07:18.685918 14839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.684339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:40779 (local address 127.9.94.1:43869)
0808 07:07:18.684412 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:18.684415 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:18.684424 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:18.684457 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:18.684459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:18.684470 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:18.684564 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:18.685446 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:18.685448 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:18.685449 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:18.685454 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:18.685471 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:18.685476 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:18.685556 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:18.685831 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 07:07:18.685850 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 07:07:18.685963 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.684338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:52971 (local address 127.9.94.2:45741)
0808 07:07:18.684396 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:18.684399 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:18.684537 (+ 138us) server_negotiation.cc:407] Connection header received
0808 07:07:18.684593 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:18.684594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:18.684599 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:18.684669 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:18.685446 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:18.685448 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:18.685449 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:18.685454 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:18.685471 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:18.685476 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:18.685556 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:18.685823 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 07:07:18.685841 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:07:18.686244 14646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f63ac27c9d44d058992946b0bcef09e" candidate_uuid: "9306faec6b9a40079d0c71a632d66c29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6b6a75fce9644a8a4f51e4da95f00b9" is_pre_election: true
I20260808 07:07:18.686254 14511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f63ac27c9d44d058992946b0bcef09e" candidate_uuid: "9306faec6b9a40079d0c71a632d66c29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "273e3580ded444e58c5354176e1fa2d2" is_pre_election: true
I20260808 07:07:18.686401 14646 raft_consensus.cc:2454] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9306faec6b9a40079d0c71a632d66c29 in term 0.
I20260808 07:07:18.686414 14511 raft_consensus.cc:2454] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9306faec6b9a40079d0c71a632d66c29 in term 0.
I20260808 07:07:18.686687 14715 leader_election.cc:302] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9306faec6b9a40079d0c71a632d66c29, c6b6a75fce9644a8a4f51e4da95f00b9; no voters:
I20260808 07:07:18.686868 14848 raft_consensus.cc:2781] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:18.686962 14848 raft_consensus.cc:482] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:18.687004 14848 raft_consensus.cc:3037] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:18.687891 14848 raft_consensus.cc:504] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "273e3580ded444e58c5354176e1fa2d2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43869 } } peers { permanent_uuid: "c6b6a75fce9644a8a4f51e4da95f00b9" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 45741 } } peers { permanent_uuid: "9306faec6b9a40079d0c71a632d66c29" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36875 } }
I20260808 07:07:18.688072 14848 leader_election.cc:288] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [CANDIDATE]: Term 1 election: Requested vote from peers 273e3580ded444e58c5354176e1fa2d2 (127.9.94.1:43869), c6b6a75fce9644a8a4f51e4da95f00b9 (127.9.94.2:45741)
I20260808 07:07:18.688297 14511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f63ac27c9d44d058992946b0bcef09e" candidate_uuid: "9306faec6b9a40079d0c71a632d66c29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "273e3580ded444e58c5354176e1fa2d2"
I20260808 07:07:18.688315 14646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f63ac27c9d44d058992946b0bcef09e" candidate_uuid: "9306faec6b9a40079d0c71a632d66c29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6b6a75fce9644a8a4f51e4da95f00b9"
I20260808 07:07:18.688409 14646 raft_consensus.cc:3037] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:18.688413 14511 raft_consensus.cc:3037] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:18.689256 14646 raft_consensus.cc:2454] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9306faec6b9a40079d0c71a632d66c29 in term 1.
I20260808 07:07:18.689262 14511 raft_consensus.cc:2454] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9306faec6b9a40079d0c71a632d66c29 in term 1.
I20260808 07:07:18.689466 14714 leader_election.cc:302] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 273e3580ded444e58c5354176e1fa2d2, 9306faec6b9a40079d0c71a632d66c29; no voters:
I20260808 07:07:18.689592 14848 raft_consensus.cc:2781] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:18.689769 14848 raft_consensus.cc:686] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [term 1 LEADER]: Becoming Leader. State: Replica: 9306faec6b9a40079d0c71a632d66c29, State: Running, Role: LEADER
I20260808 07:07:18.689886 14848 consensus_queue.cc:237] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "273e3580ded444e58c5354176e1fa2d2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43869 } } peers { permanent_uuid: "c6b6a75fce9644a8a4f51e4da95f00b9" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 45741 } } peers { permanent_uuid: "9306faec6b9a40079d0c71a632d66c29" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36875 } }
I20260808 07:07:18.690872 14362 catalog_manager.cc:5495] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9306faec6b9a40079d0c71a632d66c29 (127.9.94.3). New cstate: current_term: 1 leader_uuid: "9306faec6b9a40079d0c71a632d66c29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "273e3580ded444e58c5354176e1fa2d2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6b6a75fce9644a8a4f51e4da95f00b9" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 45741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9306faec6b9a40079d0c71a632d66c29" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36875 } health_report { overall_health: HEALTHY } } }
W20260808 07:07:18.701336 14694 tablet.cc:2369] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:07:18.706773 14841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.704360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36572 (local address 127.9.94.3:36875)
0808 07:07:18.704440 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:18.704442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:18.704453 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:18.704497 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:18.704498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:18.704520 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:18.704588 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:18.706186 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:18.706188 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:18.706188 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:18.706195 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:18.706215 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:18.706219 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:18.706294 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:18.706631 (+ 337us) server_negotiation.cc:299] Negotiation successful
0808 07:07:18.706650 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 07:07:18.708994 14646 raft_consensus.cc:1261] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9 [term 1 FOLLOWER]: Refusing update from remote peer 9306faec6b9a40079d0c71a632d66c29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:18.709036 14511 raft_consensus.cc:1261] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2 [term 1 FOLLOWER]: Refusing update from remote peer 9306faec6b9a40079d0c71a632d66c29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:18.709460 14852 consensus_queue.cc:1035] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6b6a75fce9644a8a4f51e4da95f00b9" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 45741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:18.709604 14848 consensus_queue.cc:1035] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "273e3580ded444e58c5354176e1fa2d2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:18.712771 14857 mvcc.cc:205] Tried to move back new op lower bound from 7316163947348123648 to 7316163947274653696. Current Snapshot: MvccSnapshot[applied={T|T < 7316163947348123648}]
I20260808 07:07:18.713214 14856 mvcc.cc:205] Tried to move back new op lower bound from 7316163947348123648 to 7316163947274653696. Current Snapshot: MvccSnapshot[applied={T|T < 7316163947348123648}]
I20260808 07:07:18.715302 14362 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:18.715435 14362 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:18.716378 14362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3b5f46ed964a485199205ba2fdde3ca2: Sending DeleteTablet for 3 replicas of tablet 3f63ac27c9d44d058992946b0bcef09e
I20260808 07:07:18.716858 14626 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f63ac27c9d44d058992946b0bcef09e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:18 UTC) from {username='slave'} at 127.0.0.1:46888
I20260808 07:07:18.716779 14490 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f63ac27c9d44d058992946b0bcef09e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:18 UTC) from {username='slave'} at 127.0.0.1:36044
I20260808 07:07:18.717103 14761 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f63ac27c9d44d058992946b0bcef09e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:18 UTC) from {username='slave'} at 127.0.0.1:36556
I20260808 07:07:18.717360 14865 tablet_replica.cc:330] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29: stopping tablet replica
I20260808 07:07:18.717471 14866 tablet_replica.cc:330] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2: stopping tablet replica
I20260808 07:07:18.717494 14865 raft_consensus.cc:2229] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:07:18.717605 14865 raft_consensus.cc:2258] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:18.717628 14866 raft_consensus.cc:2229] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:18.717746 14866 raft_consensus.cc:2258] T 3f63ac27c9d44d058992946b0bcef09e P 273e3580ded444e58c5354176e1fa2d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:18.717828 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 14425
I20260808 07:07:18.718592 14864 tablet_replica.cc:330] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9: stopping tablet replica
I20260808 07:07:18.718719 14864 raft_consensus.cc:2229] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:18.718981 14864 raft_consensus.cc:2258] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:18.719753 14865 ts_tablet_manager.cc:1905] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:18.722429 14865 ts_tablet_manager.cc:1918] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:18.723023 14864 ts_tablet_manager.cc:1905] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:18.724489 14865 log.cc:1196] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/3f63ac27c9d44d058992946b0bcef09e
I20260808 07:07:18.724938 14865 ts_tablet_manager.cc:1939] T 3f63ac27c9d44d058992946b0bcef09e P 9306faec6b9a40079d0c71a632d66c29: Deleting consensus metadata
I20260808 07:07:18.725454 14864 ts_tablet_manager.cc:1918] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:18.725512 14345 catalog_manager.cc:4841] TS 9306faec6b9a40079d0c71a632d66c29 (127.9.94.3:36875): tablet 3f63ac27c9d44d058992946b0bcef09e (table test-table [id=429d40c5ee704713841d0e46c722c90c]) successfully deleted
I20260808 07:07:18.725579 14864 log.cc:1196] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/3f63ac27c9d44d058992946b0bcef09e
I20260808 07:07:18.725873 14864 ts_tablet_manager.cc:1939] T 3f63ac27c9d44d058992946b0bcef09e P c6b6a75fce9644a8a4f51e4da95f00b9: Deleting consensus metadata
I20260808 07:07:18.726343 14348 catalog_manager.cc:4841] TS c6b6a75fce9644a8a4f51e4da95f00b9 (127.9.94.2:45741): tablet 3f63ac27c9d44d058992946b0bcef09e (table test-table [id=429d40c5ee704713841d0e46c722c90c]) successfully deleted
W20260808 07:07:18.727816 14347 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:43869 (error 108)
I20260808 07:07:18.728055 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 14561
I20260808 07:07:18.730854 14837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.730669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:43869 (local address 127.0.0.1:36060)
0808 07:07:18.730727 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:18.730800 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:43869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 07:07:18.731045 14347 catalog_manager.cc:4584] TS 273e3580ded444e58c5354176e1fa2d2 (127.9.94.1:43869): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3f63ac27c9d44d058992946b0bcef09e: Network error: Client connection negotiation failed: client connection to 127.9.94.1:43869: connect: Connection refused (error 111)
I20260808 07:07:18.738533 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 14696
I20260808 07:07:18.746016 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 14330
2026-08-08T07:07:18Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (759 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 07:07:18.769557 9592 mini_oidc.cc:152] Starting JWKS server
I20260808 07:07:18.770757 9592 webserver.cc:460] Webserver started at https://127.0.0.1:35841/ using document root <none> and password file <none>
I20260808 07:07:18.770843 9592 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 07:07:18.771044 9592 webserver.cc:460] Webserver started at http://127.0.0.1:42537/ using document root <none> and password file <none>
2026-08-08T07:07:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:18Z Disabled control of system clock
I20260808 07:07:18.781462 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:37437
--webserver_interface=127.9.94.62
--webserver_port=0
--builtin_ntp_servers=127.9.94.20:45107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:37437
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35841/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/testchainca.cert with env {}
W20260808 07:07:18.870826 14873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:18.871062 14873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:18.871086 14873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:18.872319 14873 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:18.872370 14873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:18.872382 14873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:18.872395 14873 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:18.872408 14873 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 07:07:18.872460 14873 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 07:07:18.872479 14873 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35841/jwks.json
I20260808 07:07:18.874115 14873 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:45107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:37437
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:37437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35841/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:18.874409 14873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:18.874652 14873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:18.879680 14878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:18.879685 14881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:18.879740 14879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:18.880050 14873 server_base.cc:1034] running on GCE node
I20260808 07:07:18.880390 14873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:18.880707 14873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:18.881916 14873 hybrid_clock.cc:648] HybridClock initialized: now 1786172838881880 us; error 44 us; skew 500 ppm
I20260808 07:07:18.883721 14873 webserver.cc:460] Webserver started at http://127.9.94.62:46051/ using document root <none> and password file <none>
I20260808 07:07:18.884011 14873 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:18.884090 14873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:18.884262 14873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:18.885558 14873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "a7a15fe76a9b4b1e856c5c4dfc45044f"
format_stamp: "Formatted at 2026-08-08 07:07:18 on dist-test-slave-77v9"
server_key: "8c6022d8bb13b14ce39f079beb16c89f"
server_key_iv: "5f1cd99044a0258386dff53f5a8acd80"
server_key_version: "encryptionkey@0"
I20260808 07:07:18.885977 14873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "a7a15fe76a9b4b1e856c5c4dfc45044f"
format_stamp: "Formatted at 2026-08-08 07:07:18 on dist-test-slave-77v9"
server_key: "8c6022d8bb13b14ce39f079beb16c89f"
server_key_iv: "5f1cd99044a0258386dff53f5a8acd80"
server_key_version: "encryptionkey@0"
I20260808 07:07:18.887528 14873 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:07:18.889212 14888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:18.889478 14873 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260808 07:07:18.889601 14873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "a7a15fe76a9b4b1e856c5c4dfc45044f"
format_stamp: "Formatted at 2026-08-08 07:07:18 on dist-test-slave-77v9"
server_key: "8c6022d8bb13b14ce39f079beb16c89f"
server_key_iv: "5f1cd99044a0258386dff53f5a8acd80"
server_key_version: "encryptionkey@0"
I20260808 07:07:18.889855 14873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:18.913961 14873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:18.914378 14873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:18.914563 14873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:18.919466 14873 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:37437
I20260808 07:07:18.919526 14944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:37437 every 8 connection(s)
I20260808 07:07:18.919947 14873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:18.921195 14945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:18.923578 14945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f: Bootstrap starting.
I20260808 07:07:18.924160 14945 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:18.924435 14945 log.cc:824] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:18.925426 14945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f: No bootstrap required, opened a new log
I20260808 07:07:18.927016 14945 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a15fe76a9b4b1e856c5c4dfc45044f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37437 } }
I20260808 07:07:18.927165 14945 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:18.927187 14945 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7a15fe76a9b4b1e856c5c4dfc45044f, State: Initialized, Role: FOLLOWER
I20260808 07:07:18.927337 14945 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a15fe76a9b4b1e856c5c4dfc45044f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37437 } }
I20260808 07:07:18.927436 14945 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:18.927461 14945 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:18.927515 14945 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:18.927676 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 14873
I20260808 07:07:18.927788 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:18.927981 9592 external_mini_cluster.cc:1428] Setting key a64a08f291399b66c9b52db1c13ce2b5
I20260808 07:07:18.928179 14945 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a15fe76a9b4b1e856c5c4dfc45044f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37437 } }
I20260808 07:07:18.928293 14945 leader_election.cc:302] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7a15fe76a9b4b1e856c5c4dfc45044f; no voters:
I20260808 07:07:18.928476 14945 leader_election.cc:288] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:18.928508 14948 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:18.928717 14948 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [term 1 LEADER]: Becoming Leader. State: Replica: a7a15fe76a9b4b1e856c5c4dfc45044f, State: Running, Role: LEADER
I20260808 07:07:18.928861 14945 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:18.928838 14948 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a15fe76a9b4b1e856c5c4dfc45044f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37437 } }
I20260808 07:07:18.929155 14948 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7a15fe76a9b4b1e856c5c4dfc45044f. Latest consensus state: current_term: 1 leader_uuid: "a7a15fe76a9b4b1e856c5c4dfc45044f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a15fe76a9b4b1e856c5c4dfc45044f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37437 } } }
I20260808 07:07:18.929234 14948 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:18.929282 14951 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7a15fe76a9b4b1e856c5c4dfc45044f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a15fe76a9b4b1e856c5c4dfc45044f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37437 } } }
I20260808 07:07:18.929343 14951 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:18.929466 14954 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:18.930224 14954 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:18.932142 14954 catalog_manager.cc:1347] Generated new cluster ID: f0a94f444cd54227a4eaa85e47676a26
I20260808 07:07:18.932245 14954 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:18.934468 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.928675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52268 (local address 127.9.94.62:37437)
0808 07:07:18.928904 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:18.928913 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:18.928947 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:07:18.929071 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:18.929089 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:18.929165 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:18.929619 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:18.929789 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:18.931213 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:18.932236 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:18.932707 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:18.932884 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:18.933589 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:18.933592 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:18.933593 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:18.933784 (+ 191us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:18.933817 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:18.933829 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:18.933909 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:18.934119 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 07:07:18.934208 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":78,"threads_started":1}
I20260808 07:07:18.935540 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:07:18.943003 14954 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:18.943806 14954 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:18.949983 14954 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7a15fe76a9b4b1e856c5c4dfc45044f: Generated new TSK 0
I20260808 07:07:18.950191 14954 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 07:07:18.978035 14976 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 07:07:18.978226 14976 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 07:07:18.978449 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:18.961917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52274 (local address 127.9.94.62:37437)
0808 07:07:18.961994 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:18.961997 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:18.962144 (+ 147us) server_negotiation.cc:407] Connection header received
0808 07:07:18.962301 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:18.962303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:18.962315 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:18.962393 (+ 78us) server_negotiation.cc:226] Negotiated authn=JWT
0808 07:07:18.962601 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:18.963142 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:18.964332 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:18.964566 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:18.964643 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:18.964946 (+ 303us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 07:07:18.978137 (+ 13191us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35841/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 07:07:18.978363 (+ 226us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52274: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35841/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 07:07:18.978569 14952 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52274: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35841/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 07:07:18.978963 14975 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:18.961836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:37437 (local address 127.0.0.1:52274)
0808 07:07:18.962057 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:18.962070 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:18.962154 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:18.962417 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:18.962418 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:18.962421 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0808 07:07:18.962503 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:18.962506 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:18.963235 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:18.963236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:18.964219 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:18.964222 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:18.964655 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:18.964661 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:18.964729 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:18.964756 (+ 27us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 07:07:18.978489 (+ 13733us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35841/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 07:07:18.978628 (+ 139us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.94.62:37437: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35841/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":130,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.9.94.62:37437: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35841/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 07:07:18.979700 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 14873
2026-08-08T07:07:19Z chronyd exiting
I20260808 07:07:19.018836 9592 test_util.cc:175] -----------------------------------------------
I20260808 07:07:19.018929 9592 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172813832116-9592-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (250 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 07:07:19.019789 9592 mini_oidc.cc:152] Starting JWKS server
I20260808 07:07:19.020953 9592 webserver.cc:460] Webserver started at https://127.0.0.1:41809/ using document root <none> and password file <none>
I20260808 07:07:19.021018 9592 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 07:07:19.021183 9592 webserver.cc:460] Webserver started at http://127.0.0.1:43855/ using document root <none> and password file <none>
2026-08-08T07:07:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:19Z Disabled control of system clock
I20260808 07:07:19.031208 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36263
--webserver_interface=127.9.94.62
--webserver_port=0
--builtin_ntp_servers=127.9.94.20:42297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:36263
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41809/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/testchainca.cert with env {}
W20260808 07:07:19.122586 14983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:19.122862 14983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:19.122903 14983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:19.124114 14983 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:19.124184 14983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:19.124208 14983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:19.124241 14983 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:19.124266 14983 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 07:07:19.124292 14983 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 07:07:19.124318 14983 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41809/jwks.json
I20260808 07:07:19.126040 14983 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:42297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:36263
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41809/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:19.126341 14983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:19.126595 14983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:19.131671 14991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:19.131763 14988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:19.131763 14989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:19.132038 14983 server_base.cc:1034] running on GCE node
I20260808 07:07:19.132292 14983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:19.132616 14983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:19.133766 14983 hybrid_clock.cc:648] HybridClock initialized: now 1786172839133729 us; error 52 us; skew 500 ppm
I20260808 07:07:19.135236 14983 webserver.cc:460] Webserver started at http://127.9.94.62:33787/ using document root <none> and password file <none>
I20260808 07:07:19.135504 14983 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:19.135582 14983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:19.135737 14983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:19.136946 14983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "5a74e6c939d44fb1838d65f75ab84a6c"
format_stamp: "Formatted at 2026-08-08 07:07:19 on dist-test-slave-77v9"
server_key: "e20232cc125dbbf238bb287aa0d5b72a"
server_key_iv: "e453d74270923a172c791fe2ce97dfc6"
server_key_version: "encryptionkey@0"
I20260808 07:07:19.137336 14983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "5a74e6c939d44fb1838d65f75ab84a6c"
format_stamp: "Formatted at 2026-08-08 07:07:19 on dist-test-slave-77v9"
server_key: "e20232cc125dbbf238bb287aa0d5b72a"
server_key_iv: "e453d74270923a172c791fe2ce97dfc6"
server_key_version: "encryptionkey@0"
I20260808 07:07:19.138932 14983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:07:19.140089 14997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:19.140574 14983 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:19.140724 14983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "5a74e6c939d44fb1838d65f75ab84a6c"
format_stamp: "Formatted at 2026-08-08 07:07:19 on dist-test-slave-77v9"
server_key: "e20232cc125dbbf238bb287aa0d5b72a"
server_key_iv: "e453d74270923a172c791fe2ce97dfc6"
server_key_version: "encryptionkey@0"
I20260808 07:07:19.140923 14983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:19.165949 14983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:19.166359 14983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:19.166564 14983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:19.171257 14983 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:36263
I20260808 07:07:19.171294 15051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:36263 every 8 connection(s)
I20260808 07:07:19.171697 14983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:19.172703 15052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:19.175554 15052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c: Bootstrap starting.
I20260808 07:07:19.176224 15052 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:19.176540 15052 log.cc:824] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:19.177448 15052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c: No bootstrap required, opened a new log
I20260808 07:07:19.177471 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 14983
I20260808 07:07:19.177686 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:19.177924 9592 external_mini_cluster.cc:1428] Setting key c82818e6387791d8129102508aff9d00
I20260808 07:07:19.179627 15052 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a74e6c939d44fb1838d65f75ab84a6c" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36263 } }
I20260808 07:07:19.179817 15052 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:19.179881 15052 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a74e6c939d44fb1838d65f75ab84a6c, State: Initialized, Role: FOLLOWER
I20260808 07:07:19.180081 15052 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a74e6c939d44fb1838d65f75ab84a6c" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36263 } }
I20260808 07:07:19.180183 15052 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:19.180227 15052 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:19.180272 15052 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:19.184914 15056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:19.178578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41974 (local address 127.9.94.62:36263)
0808 07:07:19.178886 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:19.178894 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:19.178924 (+ 30us) server_negotiation.cc:407] Connection header received
0808 07:07:19.179616 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:19.179624 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:19.179693 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:19.179967 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:19.180319 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.181606 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.182627 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.183054 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.183149 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:19.183989 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:19.183992 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:19.183993 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:19.184178 (+ 185us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:19.184263 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:19.184277 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:19.184350 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:19.184574 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 07:07:19.184652 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":93,"threads_started":1}
I20260808 07:07:19.186053 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:07:19.189440 15052 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a74e6c939d44fb1838d65f75ab84a6c" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36263 } }
I20260808 07:07:19.189610 15052 leader_election.cc:302] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a74e6c939d44fb1838d65f75ab84a6c; no voters:
I20260808 07:07:19.189885 15052 leader_election.cc:288] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:19.190014 15057 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:19.190201 15057 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [term 1 LEADER]: Becoming Leader. State: Replica: 5a74e6c939d44fb1838d65f75ab84a6c, State: Running, Role: LEADER
I20260808 07:07:19.190200 15052 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:19.190344 15057 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a74e6c939d44fb1838d65f75ab84a6c" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36263 } }
I20260808 07:07:19.190762 15058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a74e6c939d44fb1838d65f75ab84a6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a74e6c939d44fb1838d65f75ab84a6c" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36263 } } }
I20260808 07:07:19.190765 15060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a74e6c939d44fb1838d65f75ab84a6c. Latest consensus state: current_term: 1 leader_uuid: "5a74e6c939d44fb1838d65f75ab84a6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a74e6c939d44fb1838d65f75ab84a6c" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36263 } } }
I20260808 07:07:19.190937 15058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:19.190948 15060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:19.191450 15068 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:19.191998 15068 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:19.194464 15068 catalog_manager.cc:1347] Generated new cluster ID: 8e27300c2fed4f46abf883666f12b5c1
I20260808 07:07:19.194538 15068 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:19.201967 15068 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:19.202538 15068 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:19.209517 15068 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a74e6c939d44fb1838d65f75ab84a6c: Generated new TSK 0
I20260808 07:07:19.209756 15068 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 07:07:19.235036 15085 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 07:07:19.235144 15085 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 07:07:19.235514 15056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:19.218084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41978 (local address 127.9.94.62:36263)
0808 07:07:19.218146 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:19.218148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:19.218301 (+ 153us) server_negotiation.cc:407] Connection header received
0808 07:07:19.218355 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:19.218356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:19.218372 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:19.218445 (+ 73us) server_negotiation.cc:226] Negotiated authn=JWT
0808 07:07:19.218601 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.219240 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.220677 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.221031 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.221093 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:19.221302 (+ 209us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 07:07:19.235320 (+ 14018us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41809/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 07:07:19.235459 (+ 139us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41978: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41809/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":34}
W20260808 07:07:19.235589 15056 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41978: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41809/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 07:07:19.235731 15084 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:19.218008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36263 (local address 127.0.0.1:41978)
0808 07:07:19.218199 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:19.218211 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:19.218288 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:19.218461 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:19.218462 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:19.218464 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 07:07:19.218528 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:19.218531 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.219359 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.219360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:19.220570 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:19.220574 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.221119 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.221123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:19.221188 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:19.221195 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 07:07:19.235453 (+ 14258us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41809/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 07:07:19.235602 (+ 149us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.94.62:36263: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41809/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":86,"threads_started":1}
I20260808 07:07:19.236225 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 14983
2026-08-08T07:07:19Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (257 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 07:07:19.277079 9592 mini_oidc.cc:152] Starting JWKS server
I20260808 07:07:19.277930 9592 webserver.cc:460] Webserver started at https://127.0.0.1:44583/ using document root <none> and password file <none>
I20260808 07:07:19.277981 9592 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 07:07:19.278160 9592 webserver.cc:460] Webserver started at http://127.0.0.1:44435/ using document root <none> and password file <none>
2026-08-08T07:07:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:19Z Disabled control of system clock
I20260808 07:07:19.289026 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36219
--webserver_interface=127.9.94.62
--webserver_port=0
--builtin_ntp_servers=127.9.94.20:38419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:36219
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44583/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 07:07:19.379383 15091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:19.379602 15091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:19.379624 15091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:19.380759 15091 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:19.380800 15091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:19.380861 15091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:19.380884 15091 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:19.380908 15091 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 07:07:19.380920 15091 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 07:07:19.380931 15091 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44583/jwks.json
I20260808 07:07:19.382298 15091 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:36219
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44583/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15091
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:19.382526 15091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:19.382782 15091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:19.387799 15096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:19.387802 15099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:19.387876 15097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:19.388255 15091 server_base.cc:1034] running on GCE node
I20260808 07:07:19.388528 15091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:19.388932 15091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:19.390156 15091 hybrid_clock.cc:648] HybridClock initialized: now 1786172839390138 us; error 31 us; skew 500 ppm
I20260808 07:07:19.391728 15091 webserver.cc:460] Webserver started at http://127.9.94.62:36327/ using document root <none> and password file <none>
I20260808 07:07:19.392115 15091 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:19.392203 15091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:19.392381 15091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:19.393698 15091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "5065556a89b441918ed330259ed8b6a3"
format_stamp: "Formatted at 2026-08-08 07:07:19 on dist-test-slave-77v9"
server_key: "8870b6f0cf42142de2da8a5bab5ff590"
server_key_iv: "65e5806c3b7fdde4b06751eec16fbc39"
server_key_version: "encryptionkey@0"
I20260808 07:07:19.394179 15091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "5065556a89b441918ed330259ed8b6a3"
format_stamp: "Formatted at 2026-08-08 07:07:19 on dist-test-slave-77v9"
server_key: "8870b6f0cf42142de2da8a5bab5ff590"
server_key_iv: "65e5806c3b7fdde4b06751eec16fbc39"
server_key_version: "encryptionkey@0"
I20260808 07:07:19.395802 15091 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:07:19.397030 15105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:19.397236 15091 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:19.397365 15091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "5065556a89b441918ed330259ed8b6a3"
format_stamp: "Formatted at 2026-08-08 07:07:19 on dist-test-slave-77v9"
server_key: "8870b6f0cf42142de2da8a5bab5ff590"
server_key_iv: "65e5806c3b7fdde4b06751eec16fbc39"
server_key_version: "encryptionkey@0"
I20260808 07:07:19.397459 15091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:19.408526 15091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:19.408993 15091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:19.409155 15091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:19.413954 15091 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:36219
I20260808 07:07:19.414021 15159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:36219 every 8 connection(s)
I20260808 07:07:19.414412 15091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:19.415323 15160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:19.418179 15160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3: Bootstrap starting.
I20260808 07:07:19.418838 15160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:19.419142 15160 log.cc:824] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:19.420013 15160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3: No bootstrap required, opened a new log
I20260808 07:07:19.422030 15160 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5065556a89b441918ed330259ed8b6a3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36219 } }
I20260808 07:07:19.422235 15160 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:19.422287 15160 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5065556a89b441918ed330259ed8b6a3, State: Initialized, Role: FOLLOWER
I20260808 07:07:19.422483 15160 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5065556a89b441918ed330259ed8b6a3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36219 } }
I20260808 07:07:19.422572 15160 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:19.422612 15160 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:19.422665 15160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:19.424633 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 15091
I20260808 07:07:19.424726 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:19.424974 9592 external_mini_cluster.cc:1428] Setting key a25a9cdae5683e07c8f0a0718175dfba
I20260808 07:07:19.430544 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:19.425583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36562 (local address 127.9.94.62:36219)
0808 07:07:19.425857 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:19.425865 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:19.425897 (+ 32us) server_negotiation.cc:407] Connection header received
0808 07:07:19.426019 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:19.426025 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:19.426082 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:19.426251 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:19.426549 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.427726 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.428508 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.429001 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.429146 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:19.429882 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:19.429886 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:19.429887 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:19.430075 (+ 188us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:19.430109 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:19.430120 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:19.430192 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:19.430283 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 07:07:19.430368 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":99,"threads_started":1}
I20260808 07:07:19.431743 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:07:19.492228 15160 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5065556a89b441918ed330259ed8b6a3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36219 } }
I20260808 07:07:19.492480 15160 leader_election.cc:302] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5065556a89b441918ed330259ed8b6a3; no voters:
I20260808 07:07:19.492769 15160 leader_election.cc:288] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:19.493142 15166 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:19.493177 15160 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:19.493363 15166 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [term 1 LEADER]: Becoming Leader. State: Replica: 5065556a89b441918ed330259ed8b6a3, State: Running, Role: LEADER
I20260808 07:07:19.493485 15166 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5065556a89b441918ed330259ed8b6a3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36219 } }
I20260808 07:07:19.493974 15167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5065556a89b441918ed330259ed8b6a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5065556a89b441918ed330259ed8b6a3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36219 } } }
I20260808 07:07:19.494066 15167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:19.494300 15168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5065556a89b441918ed330259ed8b6a3. Latest consensus state: current_term: 1 leader_uuid: "5065556a89b441918ed330259ed8b6a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5065556a89b441918ed330259ed8b6a3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36219 } } }
I20260808 07:07:19.494432 15168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:19.494767 15175 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:19.495337 15175 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:19.497494 15175 catalog_manager.cc:1347] Generated new cluster ID: 7a854c5e8f8c490fb085ac63a9b13d5f
I20260808 07:07:19.497584 15175 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:19.536734 15175 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:19.537629 15175 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:19.542519 15175 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5065556a89b441918ed330259ed8b6a3: Generated new TSK 0
I20260808 07:07:19.542835 15175 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:07:19.559890 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:19.555117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36576 (local address 127.9.94.62:36219)
0808 07:07:19.555201 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:19.555204 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:19.555225 (+ 21us) server_negotiation.cc:407] Connection header received
0808 07:07:19.555385 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:19.555386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:19.555401 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:19.555485 (+ 84us) server_negotiation.cc:226] Negotiated authn=JWT
0808 07:07:19.555755 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.556339 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.557926 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.558173 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.558253 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:19.558504 (+ 251us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 07:07:19.559610 (+ 1106us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44583/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 07:07:19.559792 (+ 182us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36576: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44583/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 07:07:19.559983 15191 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:19.554889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36219 (local address 127.0.0.1:36576)
0808 07:07:19.555137 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:19.555154 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:19.555236 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:19.555506 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:19.555507 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:19.555509 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 07:07:19.555605 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:19.555608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.556496 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.556497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:19.557767 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:19.557771 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.558269 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.558279 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:19.558351 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:19.558359 (+ 8us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 07:07:19.559738 (+ 1379us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44583/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 07:07:19.559854 (+ 116us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.94.62:36219: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44583/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":140,"threads_started":1}
W20260808 07:07:19.559986 15165 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36576: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44583/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
I20260808 07:07:19.560472 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 15091
E20260808 07:07:19.576416 15192 webserver.cc:533] Webserver: sslize failed:
E20260808 07:07:19.576562 15192 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T07:07:19Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (326 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T07:07:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:19Z Disabled control of system clock
I20260808 07:07:19.612293 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36569
--webserver_interface=127.9.94.62
--webserver_port=0
--builtin_ntp_servers=127.9.94.20:44073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:36569
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/testchainca.cert with env {}
W20260808 07:07:19.700045 15199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:19.700317 15199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:19.700377 15199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:19.701645 15199 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:19.701719 15199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:19.701768 15199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:19.701803 15199 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:19.701828 15199 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 07:07:19.701858 15199 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 07:07:19.701884 15199 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 07:07:19.703974 15199 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:44073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:36569
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:19.704280 15199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:19.704509 15199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:19.710026 15204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:19.710168 15207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:19.710176 15205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:19.710299 15199 server_base.cc:1034] running on GCE node
I20260808 07:07:19.710556 15199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:19.710881 15199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:19.712050 15199 hybrid_clock.cc:648] HybridClock initialized: now 1786172839712040 us; error 39 us; skew 500 ppm
I20260808 07:07:19.713586 15199 webserver.cc:460] Webserver started at http://127.9.94.62:38175/ using document root <none> and password file <none>
I20260808 07:07:19.713888 15199 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:19.713953 15199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:19.714092 15199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:19.715260 15199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "9e396e3628c84d08923f8be12c887035"
format_stamp: "Formatted at 2026-08-08 07:07:19 on dist-test-slave-77v9"
server_key: "99be199965202d687ead1ad57084bee0"
server_key_iv: "addbd6c04911506aaea08704f8aace48"
server_key_version: "encryptionkey@0"
I20260808 07:07:19.715669 15199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "9e396e3628c84d08923f8be12c887035"
format_stamp: "Formatted at 2026-08-08 07:07:19 on dist-test-slave-77v9"
server_key: "99be199965202d687ead1ad57084bee0"
server_key_iv: "addbd6c04911506aaea08704f8aace48"
server_key_version: "encryptionkey@0"
I20260808 07:07:19.717341 15199 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 07:07:19.718266 15213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:19.718595 15199 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:19.718739 15199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "9e396e3628c84d08923f8be12c887035"
format_stamp: "Formatted at 2026-08-08 07:07:19 on dist-test-slave-77v9"
server_key: "99be199965202d687ead1ad57084bee0"
server_key_iv: "addbd6c04911506aaea08704f8aace48"
server_key_version: "encryptionkey@0"
I20260808 07:07:19.718875 15199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:19.733683 15199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:19.734050 15199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:19.734215 15199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:19.738663 15199 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:36569
I20260808 07:07:19.739042 15269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:36569 every 8 connection(s)
I20260808 07:07:19.739084 15199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:19.740221 15270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:19.742933 15270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035: Bootstrap starting.
I20260808 07:07:19.743602 15270 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:19.743943 15270 log.cc:824] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:19.744871 15270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035: No bootstrap required, opened a new log
I20260808 07:07:19.747130 15270 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e396e3628c84d08923f8be12c887035" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36569 } }
I20260808 07:07:19.747300 15270 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:19.747327 15270 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e396e3628c84d08923f8be12c887035, State: Initialized, Role: FOLLOWER
I20260808 07:07:19.747515 15270 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e396e3628c84d08923f8be12c887035" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36569 } }
I20260808 07:07:19.747611 15270 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:19.747654 15270 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:19.747733 15270 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:19.747872 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 15199
I20260808 07:07:19.747996 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:19.748186 9592 external_mini_cluster.cc:1428] Setting key b39433b34f0a0742548730ff5aae94ca
I20260808 07:07:19.753852 15274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:19.748889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55140 (local address 127.9.94.62:36569)
0808 07:07:19.749141 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:19.749148 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:19.749174 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:07:19.749274 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:19.749280 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:19.749340 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:19.749529 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:19.749714 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.750632 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.751446 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.751863 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.752013 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:19.753046 (+ 1033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:19.753051 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:19.753051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:19.753240 (+ 189us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:19.753274 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:19.753313 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:19.753376 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:19.753464 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 07:07:19.753549 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":94,"threads_started":1}
I20260808 07:07:19.755105 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:07:19.782711 15270 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e396e3628c84d08923f8be12c887035" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36569 } }
I20260808 07:07:19.783007 15270 leader_election.cc:302] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e396e3628c84d08923f8be12c887035; no voters:
I20260808 07:07:19.783299 15270 leader_election.cc:288] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:19.783485 15275 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:19.783638 15270 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:19.783677 15275 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [term 1 LEADER]: Becoming Leader. State: Replica: 9e396e3628c84d08923f8be12c887035, State: Running, Role: LEADER
I20260808 07:07:19.783871 15275 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e396e3628c84d08923f8be12c887035" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36569 } }
I20260808 07:07:19.784538 15276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e396e3628c84d08923f8be12c887035" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e396e3628c84d08923f8be12c887035" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36569 } } }
I20260808 07:07:19.784659 15276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:19.784973 15277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e396e3628c84d08923f8be12c887035. Latest consensus state: current_term: 1 leader_uuid: "9e396e3628c84d08923f8be12c887035" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e396e3628c84d08923f8be12c887035" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36569 } } }
I20260808 07:07:19.785076 15284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:19.785085 15277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:19.785676 15284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:19.787331 15284 catalog_manager.cc:1347] Generated new cluster ID: 141a2fbc6c2240529895a241bb2b99cf
I20260808 07:07:19.787400 15284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:19.808288 15284 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:19.808975 15284 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:19.813707 15284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e396e3628c84d08923f8be12c887035: Generated new TSK 0
I20260808 07:07:19.813942 15284 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:07:19.886116 15300 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:19.830483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36569 (local address 127.0.0.1:55142)
0808 07:07:19.830694 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:19.830708 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:19.830800 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:19.830991 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:19.830992 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:19.830994 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 07:07:19.831065 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:19.831067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.831839 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.831841 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:19.833087 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:19.833091 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.833525 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.833536 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:19.833618 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:19.833624 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 07:07:19.885834 (+ 52210us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 07:07:19.885998 (+ 164us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.94.62:36569: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":116,"threads_started":1}
I20260808 07:07:19.886628 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 15199
I20260808 07:07:19.886678 15274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:19.830569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55142 (local address 127.9.94.62:36569)
0808 07:07:19.830645 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:19.830647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:19.830785 (+ 138us) server_negotiation.cc:407] Connection header received
0808 07:07:19.830885 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:19.830886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:19.830899 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:19.830970 (+ 71us) server_negotiation.cc:226] Negotiated authn=JWT
0808 07:07:19.831134 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.831745 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.833213 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:19.833438 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:19.833504 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:19.833780 (+ 276us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 07:07:19.885621 (+ 51841us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 07:07:19.886590 (+ 969us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55142: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":44}
2026-08-08T07:07:19Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (302 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (103 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (115 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:07:20 dist-test-slave-77v9 krb5kdc[15313](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:07:20 dist-test-slave-77v9 krb5kdc[15313](info): set up 2 sockets
Aug 08 07:07:20 dist-test-slave-77v9 krb5kdc[15313](info): commencing operation
krb5kdc: starting...
W20260808 07:07:22.016281 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.889s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:07:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:07:22.169607 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:37049
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:44311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:37049
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:22.263759 15326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:22.264027 15326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:22.264055 15326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:22.265578 15326 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:22.265635 15326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:22.265651 15326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:22.265666 15326 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:22.265681 15326 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:22.267411 15326 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:44311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:37049
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:37049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:22.267710 15326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:22.267994 15326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:22.273693 15334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:22.273702 15331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:22.273693 15332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:22.274066 15326 server_base.cc:1034] running on GCE node
I20260808 07:07:22.274317 15326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:22.274590 15326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:22.275799 15326 hybrid_clock.cc:648] HybridClock initialized: now 1786172842275776 us; error 46 us; skew 500 ppm
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:22.284058 15326 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:07:22.284672 15326 webserver.cc:460] Webserver started at http://127.9.94.62:42593/ using document root <none> and password file <none>
I20260808 07:07:22.285035 15326 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:22.285120 15326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:22.285290 15326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:22.286583 15326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "c7ff3d77549f4f2caa347f463a98d717"
format_stamp: "Formatted at 2026-08-08 07:07:22 on dist-test-slave-77v9"
server_key: "d160a129dfeafa543c6c0f360ccde9e1"
server_key_iv: "86856b418efd083c9667d93f84781ed9"
server_key_version: "encryptionkey@0"
I20260808 07:07:22.287003 15326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "c7ff3d77549f4f2caa347f463a98d717"
format_stamp: "Formatted at 2026-08-08 07:07:22 on dist-test-slave-77v9"
server_key: "d160a129dfeafa543c6c0f360ccde9e1"
server_key_iv: "86856b418efd083c9667d93f84781ed9"
server_key_version: "encryptionkey@0"
I20260808 07:07:22.288528 15326 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:07:22.289609 15342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:22.289932 15326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:22.290063 15326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "c7ff3d77549f4f2caa347f463a98d717"
format_stamp: "Formatted at 2026-08-08 07:07:22 on dist-test-slave-77v9"
server_key: "d160a129dfeafa543c6c0f360ccde9e1"
server_key_iv: "86856b418efd083c9667d93f84781ed9"
server_key_version: "encryptionkey@0"
I20260808 07:07:22.290164 15326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:22.307511 15326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:22.310065 15326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:22.310261 15326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:22.314666 15326 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:37049
I20260808 07:07:22.314710 15396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:37049 every 8 connection(s)
I20260808 07:07:22.315099 15326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:22.315949 15397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:22.316046 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 15326
I20260808 07:07:22.316157 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:22.316352 9592 external_mini_cluster.cc:1428] Setting key fb4a8b03f5c0d07e1646251c26e7c3cb
I20260808 07:07:22.319370 15397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717: Bootstrap starting.
I20260808 07:07:22.320111 15397 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:22.320436 15397 log.cc:824] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:22.321332 15397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717: No bootstrap required, opened a new log
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:22.324316 15397 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7ff3d77549f4f2caa347f463a98d717" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37049 } }
I20260808 07:07:22.324538 15397 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:22.324586 15397 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7ff3d77549f4f2caa347f463a98d717, State: Initialized, Role: FOLLOWER
I20260808 07:07:22.324738 15397 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7ff3d77549f4f2caa347f463a98d717" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37049 } }
I20260808 07:07:22.324896 15397 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:22.324962 15397 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:22.325026 15397 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:22.325937 15397 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7ff3d77549f4f2caa347f463a98d717" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37049 } }
I20260808 07:07:22.326062 15397 leader_election.cc:302] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7ff3d77549f4f2caa347f463a98d717; no voters:
I20260808 07:07:22.326243 15397 leader_election.cc:288] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:22.326344 15402 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:22.326560 15397 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:22.326596 15402 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [term 1 LEADER]: Becoming Leader. State: Replica: c7ff3d77549f4f2caa347f463a98d717, State: Running, Role: LEADER
I20260808 07:07:22.326840 15402 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7ff3d77549f4f2caa347f463a98d717" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37049 } }
I20260808 07:07:22.327355 15403 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7ff3d77549f4f2caa347f463a98d717" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7ff3d77549f4f2caa347f463a98d717" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37049 } } }
I20260808 07:07:22.327461 15403 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:22.327883 15404 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7ff3d77549f4f2caa347f463a98d717. Latest consensus state: current_term: 1 leader_uuid: "c7ff3d77549f4f2caa347f463a98d717" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7ff3d77549f4f2caa347f463a98d717" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37049 } } }
I20260808 07:07:22.327984 15404 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717 [sys.catalog]: This master's current role is: LEADER
W20260808 07:07:22.329008 15419 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:07:22.329080 15419 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:07:22.329175 15411 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:22.329378 15400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:22.316943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44024 (local address 127.9.94.62:37049)
0808 07:07:22.317104 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:22.317112 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:22.317137 (+ 25us) server_negotiation.cc:407] Connection header received
0808 07:07:22.317573 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:22.317579 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:22.317624 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:22.317735 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:22.318595 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.319599 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.320693 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.321330 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.321454 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:22.324446 (+ 2992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:22.324451 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:22.324451 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:22.324464 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:22.326781 (+ 2317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:22.327327 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:22.327331 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:22.327332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:22.327469 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:22.327733 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:22.327733 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:22.327734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:22.328138 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:22.328877 (+ 739us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:22.328963 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 07:07:22.329119 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":112,"thread_start_us":72,"threads_started":1}
I20260808 07:07:22.329392 15411 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:22.331266 15411 catalog_manager.cc:1347] Generated new cluster ID: 88216a90ff714907adb00c3e10791ba1
I20260808 07:07:22.331332 15411 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:22.346834 15411 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:22.347669 15411 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:22.353994 15411 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7ff3d77549f4f2caa347f463a98d717: Generated new TSK 0
I20260808 07:07:22.354274 15411 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:07:22.390153 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37049
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:44311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:22.485805 15424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:22.486047 15424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:22.486076 15424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:22.487458 15424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:22.487514 15424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:22.487546 15424 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:22.489372 15424 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:44311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:22.489658 15424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:22.489945 15424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:22.495944 15430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:22.495944 15432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:22.496064 15429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:22.496379 15424 server_base.cc:1034] running on GCE node
I20260808 07:07:22.496647 15424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:22.497013 15424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:22.498198 15424 hybrid_clock.cc:648] HybridClock initialized: now 1786172842498174 us; error 43 us; skew 500 ppm
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:22.501363 15424 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:07:22.501863 15424 webserver.cc:460] Webserver started at http://127.9.94.1:45179/ using document root <none> and password file <none>
I20260808 07:07:22.502108 15424 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:22.502178 15424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:22.502342 15424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:22.503422 15424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "54dcab817ecf4f64bc62dfcd6310941d"
format_stamp: "Formatted at 2026-08-08 07:07:22 on dist-test-slave-77v9"
server_key: "49554d86dc03dc9f4ac6b1eef5b7bb18"
server_key_iv: "e4c8c506382c680a57b16d7aa3303233"
server_key_version: "encryptionkey@0"
I20260808 07:07:22.503804 15424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "54dcab817ecf4f64bc62dfcd6310941d"
format_stamp: "Formatted at 2026-08-08 07:07:22 on dist-test-slave-77v9"
server_key: "49554d86dc03dc9f4ac6b1eef5b7bb18"
server_key_iv: "e4c8c506382c680a57b16d7aa3303233"
server_key_version: "encryptionkey@0"
I20260808 07:07:22.505343 15424 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:07:22.506350 15439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:22.506601 15424 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:22.506712 15424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "54dcab817ecf4f64bc62dfcd6310941d"
format_stamp: "Formatted at 2026-08-08 07:07:22 on dist-test-slave-77v9"
server_key: "49554d86dc03dc9f4ac6b1eef5b7bb18"
server_key_iv: "e4c8c506382c680a57b16d7aa3303233"
server_key_version: "encryptionkey@0"
I20260808 07:07:22.506857 15424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:22.524333 15424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:22.527231 15424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:22.527405 15424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:22.527747 15424 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:22.528124 15424 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:22.528165 15424 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:22.528189 15424 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:22.528203 15424 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:22.534528 15424 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:40349
I20260808 07:07:22.534605 15559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:40349 every 8 connection(s)
I20260808 07:07:22.535004 15424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:07:22.537426 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 15424
I20260808 07:07:22.537560 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:22.537808 9592 external_mini_cluster.cc:1428] Setting key 637f67acf629f6b560ec9bc4df9d9132
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
I20260808 07:07:22.549136 15400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:22.536262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:43759 (local address 127.9.94.62:37049)
0808 07:07:22.536352 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:22.536354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:22.536690 (+ 336us) server_negotiation.cc:407] Connection header received
0808 07:07:22.538461 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:22.538462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:22.538474 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:22.538551 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:22.539568 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.540118 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.541600 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.542006 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.542116 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:22.545496 (+ 3380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:22.545498 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:22.545498 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:22.545509 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:22.547422 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:22.547963 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:22.547964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:22.547965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:22.548037 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:22.548353 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:22.548354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:22.548355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:22.548526 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:22.548599 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:22.548984 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 07:07:22.549061 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 07:07:22.549328 15562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:22.536178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:37049 (local address 127.9.94.1:43759)
0808 07:07:22.536466 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:22.536524 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:22.538304 (+ 1780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:22.538652 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:22.538657 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:22.539127 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:22.539448 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:22.539455 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.540229 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.540230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:22.541437 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:22.541441 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.542140 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.542141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:22.542431 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:22.543165 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:22.543177 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:22.545341 (+ 2164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:22.547528 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:22.547535 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:22.547538 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:22.547852 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:22.548138 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:22.548139 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:22.548139 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:22.548264 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:22.548590 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:22.548596 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:22.548775 (+ 179us) client_negotiation.cc:769] Sending connection context
0808 07:07:22.548923 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 07:07:22.549071 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":179,"threads_started":1}
I20260808 07:07:22.550453 15560 heartbeater.cc:347] Connected to a master server at 127.9.94.62:37049
I20260808 07:07:22.550567 15560 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:22.550800 15560 heartbeater.cc:511] Master 127.9.94.62:37049 requested a full tablet report, sending...
I20260808 07:07:22.551447 15359 ts_manager.cc:194] Registered new tserver with Master: 54dcab817ecf4f64bc62dfcd6310941d (127.9.94.1:40349)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
I20260808 07:07:22.552222 15359 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:43759
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:07:22.574591 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37049
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:44311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:22.663200 15565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:22.663465 15565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:22.663509 15565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:22.664673 15565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:22.664752 15565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:22.664803 15565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:22.666373 15565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:44311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:22.666684 15565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:22.666955 15565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:22.672431 15574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:22.672485 15572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:22.672561 15565 server_base.cc:1034] running on GCE node
W20260808 07:07:22.672431 15571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:22.672957 15565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:22.673273 15565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:22.674484 15565 hybrid_clock.cc:648] HybridClock initialized: now 1786172842674461 us; error 48 us; skew 500 ppm
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:22.677434 15565 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:07:22.678021 15565 webserver.cc:460] Webserver started at http://127.9.94.2:37605/ using document root <none> and password file <none>
I20260808 07:07:22.678295 15565 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:22.678370 15565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:22.678545 15565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:22.679746 15565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "ac9eed2725fe402398c1728d19ceaee3"
format_stamp: "Formatted at 2026-08-08 07:07:22 on dist-test-slave-77v9"
server_key: "f046e7988d205ffa9d25852a16763009"
server_key_iv: "a2541cee9ac0edcf06ba08cacd3d0140"
server_key_version: "encryptionkey@0"
I20260808 07:07:22.680236 15565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "ac9eed2725fe402398c1728d19ceaee3"
format_stamp: "Formatted at 2026-08-08 07:07:22 on dist-test-slave-77v9"
server_key: "f046e7988d205ffa9d25852a16763009"
server_key_iv: "a2541cee9ac0edcf06ba08cacd3d0140"
server_key_version: "encryptionkey@0"
I20260808 07:07:22.682091 15565 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260808 07:07:22.683071 15582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:22.683344 15565 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:22.683473 15565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "ac9eed2725fe402398c1728d19ceaee3"
format_stamp: "Formatted at 2026-08-08 07:07:22 on dist-test-slave-77v9"
server_key: "f046e7988d205ffa9d25852a16763009"
server_key_iv: "a2541cee9ac0edcf06ba08cacd3d0140"
server_key_version: "encryptionkey@0"
I20260808 07:07:22.683561 15565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:22.698896 15565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:22.701581 15565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:22.701763 15565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:22.702041 15565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:22.702385 15565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:22.702447 15565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:22.702493 15565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:22.702538 15565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:22.708850 15565 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:42921
I20260808 07:07:22.709007 15700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:42921 every 8 connection(s)
I20260808 07:07:22.709276 15565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:07:22.711510 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 15565
I20260808 07:07:22.711668 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:07:22.711980 9592 external_mini_cluster.cc:1428] Setting key da6ccdb2a70a75d0b70faf003c5c1a23
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
I20260808 07:07:22.721285 15400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:22.710180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:37953 (local address 127.9.94.62:37049)
0808 07:07:22.710245 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:22.710248 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:22.710465 (+ 217us) server_negotiation.cc:407] Connection header received
0808 07:07:22.711631 (+ 1166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:22.711633 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:22.711652 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:22.711735 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:22.712774 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.713655 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.714850 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.715138 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.715205 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:22.718040 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:22.718042 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:22.718042 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:22.718051 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:22.719609 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:22.720125 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:22.720126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:22.720127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:22.720199 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:22.720483 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:22.720484 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:22.720485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:22.720623 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:22.720739 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:22.721078 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 07:07:22.721176 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 07:07:22.721504 15703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:22.710131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:37049 (local address 127.9.94.2:37953)
0808 07:07:22.710304 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:22.710347 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:22.711494 (+ 1147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:22.711896 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:22.711902 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:22.712301 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:22.712613 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:22.712620 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.713803 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.713804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:22.714693 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:22.714695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.715237 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.715238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:22.715402 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:22.716065 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:22.716076 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:22.717917 (+ 1841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:22.719750 (+ 1833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:22.719759 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:22.719761 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:22.720019 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:22.720275 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:22.720276 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:22.720277 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:22.720405 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:22.720730 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:22.720737 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:22.720931 (+ 194us) client_negotiation.cc:769] Sending connection context
0808 07:07:22.721055 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 07:07:22.721246 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
I20260808 07:07:22.722292 15701 heartbeater.cc:347] Connected to a master server at 127.9.94.62:37049
I20260808 07:07:22.722749 15701 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:22.723028 15701 heartbeater.cc:511] Master 127.9.94.62:37049 requested a full tablet report, sending...
I20260808 07:07:22.723507 15359 ts_manager.cc:194] Registered new tserver with Master: ac9eed2725fe402398c1728d19ceaee3 (127.9.94.2:42921)
I20260808 07:07:22.723914 15359 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:37953
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:07:22.746029 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37049
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:44311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:22.835847 15706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:22.836055 15706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:22.836079 15706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:22.837296 15706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:22.837340 15706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:22.837368 15706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:22.838899 15706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:44311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:22.839151 15706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:22.839396 15706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:22.844668 15712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:22.844699 15714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:22.844743 15711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:22.844969 15706 server_base.cc:1034] running on GCE node
I20260808 07:07:22.845194 15706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:22.845438 15706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:22.846611 15706 hybrid_clock.cc:648] HybridClock initialized: now 1786172842846594 us; error 28 us; skew 500 ppm
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:22.849416 15706 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:07:22.849924 15706 webserver.cc:460] Webserver started at http://127.9.94.3:39513/ using document root <none> and password file <none>
I20260808 07:07:22.850170 15706 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:22.850238 15706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:22.850387 15706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:22.851431 15706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "d529c9f51fe94ad294ff4bc363710da3"
format_stamp: "Formatted at 2026-08-08 07:07:22 on dist-test-slave-77v9"
server_key: "c7b10842082ba78e537e368c96aa6749"
server_key_iv: "7c7622258466340c9efd436f0d9615b7"
server_key_version: "encryptionkey@0"
I20260808 07:07:22.851792 15706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "d529c9f51fe94ad294ff4bc363710da3"
format_stamp: "Formatted at 2026-08-08 07:07:22 on dist-test-slave-77v9"
server_key: "c7b10842082ba78e537e368c96aa6749"
server_key_iv: "7c7622258466340c9efd436f0d9615b7"
server_key_version: "encryptionkey@0"
I20260808 07:07:22.853287 15706 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:07:22.854374 15721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:22.854622 15706 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:22.854750 15706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "d529c9f51fe94ad294ff4bc363710da3"
format_stamp: "Formatted at 2026-08-08 07:07:22 on dist-test-slave-77v9"
server_key: "c7b10842082ba78e537e368c96aa6749"
server_key_iv: "7c7622258466340c9efd436f0d9615b7"
server_key_version: "encryptionkey@0"
I20260808 07:07:22.854835 15706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:22.871690 15706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:22.874814 15706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:22.875038 15706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:22.875305 15706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:22.875629 15706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:22.875686 15706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:22.875730 15706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:22.875756 15706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:22.883279 15706 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:36817
I20260808 07:07:22.883385 15840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:36817 every 8 connection(s)
I20260808 07:07:22.883778 15706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:22.893121 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 15706
I20260808 07:07:22.893245 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:07:22.893453 9592 external_mini_cluster.cc:1428] Setting key ed9b226822018da479541ca6bc804d63
I20260808 07:07:22.895099 15400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:22.884689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:35577 (local address 127.9.94.62:37049)
0808 07:07:22.884743 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:22.884745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:22.885021 (+ 276us) server_negotiation.cc:407] Connection header received
0808 07:07:22.886178 (+ 1157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:22.886179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:22.886191 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:22.886265 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:22.887230 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.887753 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.888927 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.889118 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.889185 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:22.891628 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:22.891629 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:22.891630 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:22.891637 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:22.893273 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:22.893852 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:22.893854 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:22.893854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:22.893935 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:22.894344 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:22.894363 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:22.894363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:22.894526 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:22.894607 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:22.894961 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 07:07:22.895033 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:07:22.895383 15843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:22.884627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:37049 (local address 127.9.94.3:35577)
0808 07:07:22.884872 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:22.884919 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:22.886046 (+ 1127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:22.886346 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:22.886350 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:22.886667 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:22.887048 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:22.887053 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.887886 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.887886 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:22.888727 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:22.888730 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.889240 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.889241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:22.889361 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:22.889983 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:22.889992 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:22.891534 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:22.893405 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:22.893413 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:22.893415 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:22.893727 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:22.894086 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:22.894087 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:22.894087 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:22.894248 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:22.894634 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:22.894641 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:22.894803 (+ 162us) client_negotiation.cc:769] Sending connection context
0808 07:07:22.894914 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 07:07:22.895048 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":114,"threads_started":1}
I20260808 07:07:22.895927 15841 heartbeater.cc:347] Connected to a master server at 127.9.94.62:37049
I20260808 07:07:22.896028 15841 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:22.896261 15841 heartbeater.cc:511] Master 127.9.94.62:37049 requested a full tablet report, sending...
I20260808 07:07:22.896904 15359 ts_manager.cc:194] Registered new tserver with Master: d529c9f51fe94ad294ff4bc363710da3 (127.9.94.3:36817)
I20260808 07:07:22.897341 15359 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:35577
I20260808 07:07:22.906057 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/test-admin.keytab.
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:22.928287 9592 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 07:07:22.930831 15848 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:22.929831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48934 (local address 127.9.94.1:40349)
0808 07:07:22.930077 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:22.930081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:22.930094 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:07:22.930122 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:22.930124 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:22.930139 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:22.930217 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:22.930694 (+ 477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48934: BlockingRecv error: recv got EOF from 127.0.0.1:48934 (error 108)
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":120,"threads_started":1}
W20260808 07:07:22.931303 9592 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/krb5cc' of type FILE
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:22.932463 9592 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:22.933418 9592 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.1@KRBTEST.COM
I20260808 07:07:22.943063 15848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:22.934109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48942 (local address 127.9.94.1:40349)
0808 07:07:22.934228 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:22.934232 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:22.934248 (+ 16us) server_negotiation.cc:407] Connection header received
0808 07:07:22.934273 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:22.934273 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:22.934284 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:22.934345 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:22.934813 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.935567 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.936480 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.936905 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.937000 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:22.939624 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:22.939634 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:22.939658 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:22.939666 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:22.941521 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:22.941951 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:22.941955 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:22.941955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:22.942022 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:22.942251 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:22.942252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:22.942253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:22.942423 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:22.942641 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:22.942759 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 07:07:22.942832 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
W20260808 07:07:22.945396 15848 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:22.944650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48954 (local address 127.9.94.1:40349)
0808 07:07:22.944717 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:22.944719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:22.944735 (+ 16us) server_negotiation.cc:407] Connection header received
0808 07:07:22.944752 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:22.944752 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:22.944761 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:22.944960 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:22.945359 (+ 399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48954: BlockingRecv error: recv got EOF from 127.0.0.1:48954 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 07:07:22.945585 9592 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/krb5cc' of type FILE
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:22.946758 9592 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:22.947863 9592 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.1@KRBTEST.COM
I20260808 07:07:22.956954 15848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:22.948459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48960 (local address 127.9.94.1:40349)
0808 07:07:22.948560 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:22.948562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:22.948573 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:22.948638 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:22.948639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:22.948649 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:22.948710 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:22.949350 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.949939 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.950677 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.950922 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.950983 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:22.953508 (+ 2525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:22.953509 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:22.953510 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:22.953517 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:22.955195 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:22.955757 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:22.955759 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:22.955760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:22.955861 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:22.956078 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:22.956079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:22.956079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:22.956212 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:22.956301 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:22.956519 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 07:07:22.956668 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260808 07:07:22.958984 15848 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:22.958402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48966 (local address 127.9.94.1:40349)
0808 07:07:22.958447 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:22.958449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:22.958459 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:07:22.958531 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:22.958531 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:22.958542 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:22.958598 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:22.958906 (+ 308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48966: BlockingRecv error: recv got EOF from 127.0.0.1:48966 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 07:07:22.959281 9592 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172813832116-9592-0/krb5kdc/krb5cc)
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:22.960609 9592 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:22.961854 9592 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 07:07:22 dist-test-slave-77v9 krb5kdc[15313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.1@KRBTEST.COM
I20260808 07:07:22.970448 15848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:22.962526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48974 (local address 127.9.94.1:40349)
0808 07:07:22.962596 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:22.962598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:22.962607 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:22.962660 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:22.962660 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:22.962668 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:22.962734 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:22.963262 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.963812 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.964629 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:22.965003 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:22.965082 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:22.967471 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:22.967472 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:22.967473 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:22.967480 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:22.969056 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:22.969455 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:22.969456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:22.969457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:22.969517 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:22.969952 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:22.969954 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:22.969954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:22.970081 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:22.970167 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:22.970311 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 07:07:22.970378 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 07:07:22.971297 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 15424
I20260808 07:07:22.977576 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 15565
I20260808 07:07:22.983716 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 15706
I20260808 07:07:22.990166 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 15326
2026-08-08T07:07:22Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2886 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:07:23 dist-test-slave-77v9 krb5kdc[15862](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:07:23 dist-test-slave-77v9 krb5kdc[15862](info): set up 2 sockets
Aug 08 07:07:23 dist-test-slave-77v9 krb5kdc[15862](info): commencing operation
krb5kdc: starting...
W20260808 07:07:24.138345 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:07:24 dist-test-slave-77v9 krb5kdc[15862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:07:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:24Z Disabled control of system clock
WARNING: no policy specified for oryx/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.62.keytab.
Entry for principal oryx/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.62.keytab.
I20260808 07:07:24.281704 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:45719
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.62.keytab
--principal=oryx/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:45719
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:24.369760 15875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:24.369989 15875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:24.370014 15875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:24.371204 15875 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:24.371292 15875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:24.371320 15875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:24.371342 15875 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:24.371361 15875 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:24.372951 15875 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:45719
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.62.keytab
--principal=oryx/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:45719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:24.373164 15875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:24.373353 15875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:07:24.378738 15875 server_base.cc:1034] running on GCE node
W20260808 07:07:24.378696 15885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:24.378702 15882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:24.378702 15883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:24.379485 15875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:24.379817 15875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:24.380985 15875 hybrid_clock.cc:648] HybridClock initialized: now 1786172844380982 us; error 40 us; skew 500 ppm
Aug 08 07:07:24 dist-test-slave-77v9 krb5kdc[15862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172844, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:24.383558 15875 init.cc:377] Logged in from keytab as oryx/127.9.94.62@KRBTEST.COM (short username oryx)
I20260808 07:07:24.384061 15875 webserver.cc:460] Webserver started at http://127.9.94.62:36401/ using document root <none> and password file <none>
I20260808 07:07:24.384370 15875 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:24.384452 15875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:24.384641 15875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:24.385918 15875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "65c83b4dc8b749149b6ac835baeb7221"
format_stamp: "Formatted at 2026-08-08 07:07:24 on dist-test-slave-77v9"
server_key: "e749da63e9cb8324fa6569e003b2f343"
server_key_iv: "dddd90832221fb31897d898dad8a9126"
server_key_version: "encryptionkey@0"
I20260808 07:07:24.386332 15875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "65c83b4dc8b749149b6ac835baeb7221"
format_stamp: "Formatted at 2026-08-08 07:07:24 on dist-test-slave-77v9"
server_key: "e749da63e9cb8324fa6569e003b2f343"
server_key_iv: "dddd90832221fb31897d898dad8a9126"
server_key_version: "encryptionkey@0"
I20260808 07:07:24.388458 15875 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:07:24.389599 15892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:24.389909 15875 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:24.390051 15875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "65c83b4dc8b749149b6ac835baeb7221"
format_stamp: "Formatted at 2026-08-08 07:07:24 on dist-test-slave-77v9"
server_key: "e749da63e9cb8324fa6569e003b2f343"
server_key_iv: "dddd90832221fb31897d898dad8a9126"
server_key_version: "encryptionkey@0"
I20260808 07:07:24.390152 15875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:24.401314 15875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:24.403613 15875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:24.403862 15875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:24.408377 15875 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:45719
I20260808 07:07:24.408629 15947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:45719 every 8 connection(s)
I20260808 07:07:24.408913 15875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:24.409967 15948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:24.412478 15948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221: Bootstrap starting.
I20260808 07:07:24.413160 15948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:24.413407 15948 log.cc:824] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:24.414158 15948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221: No bootstrap required, opened a new log
I20260808 07:07:24.415908 15948 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } }
I20260808 07:07:24.416090 15948 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:24.416117 15948 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c83b4dc8b749149b6ac835baeb7221, State: Initialized, Role: FOLLOWER
I20260808 07:07:24.416262 15948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } }
I20260808 07:07:24.416349 15948 raft_consensus.cc:388] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:24.416373 15948 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:24.416402 15948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:24.417317 15948 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } }
I20260808 07:07:24.417405 15948 leader_election.cc:302] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65c83b4dc8b749149b6ac835baeb7221; no voters:
I20260808 07:07:24.417531 15948 leader_election.cc:288] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:24.417635 15951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:24.417805 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 15875
I20260808 07:07:24.417922 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:24.417838 15948 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:24.417868 15951 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [term 1 LEADER]: Becoming Leader. State: Replica: 65c83b4dc8b749149b6ac835baeb7221, State: Running, Role: LEADER
I20260808 07:07:24.418143 9592 external_mini_cluster.cc:1428] Setting key cd63f049c3e1a90ed04f43ca2998d969
I20260808 07:07:24.418174 15951 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } }
I20260808 07:07:24.418588 15952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } }
I20260808 07:07:24.418666 15952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:24.419167 15962 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:24.419135 15953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65c83b4dc8b749149b6ac835baeb7221. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } }
I20260808 07:07:24.419543 15953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:24.419724 15962 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:24.421867 15962 catalog_manager.cc:1347] Generated new cluster ID: c70e4f5dc2f34b0796410f72a3f1a7d0
I20260808 07:07:24.421938 15962 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:07:24 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
I20260808 07:07:24.431901 15962 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:24.431947 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:24.418869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53962 (local address 127.9.94.62:45719)
0808 07:07:24.419037 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:24.419048 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:24.419344 (+ 296us) server_negotiation.cc:407] Connection header received
0808 07:07:24.419590 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:24.419599 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:24.419662 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:24.419780 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:24.420658 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:24.421758 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:24.422807 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:24.423419 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:24.423520 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:24.426898 (+ 3378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:24.426903 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:24.426903 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:24.426918 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:24.430059 (+ 3141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:24.430547 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:24.430550 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:24.430551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:24.430689 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:24.430987 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:24.430988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:24.430988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:24.431285 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:24.431444 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:24.431562 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 07:07:24.431710 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260808 07:07:24.432556 15962 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:24.437860 15962 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221: Generated new TSK 0
I20260808 07:07:24.438068 15962 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.1.keytab.
Entry for principal oryx/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.1.keytab.
I20260808 07:07:24.477094 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:45719
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.1.keytab
--principal=oryx/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:24.570081 15977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:24.570297 15977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:24.570320 15977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:24.571382 15977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:24.571419 15977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:24.571445 15977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:24.572992 15977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.1.keytab
--principal=oryx/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:45719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:24.573190 15977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:24.573369 15977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:24.578647 15983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:24.578693 15985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:24.578658 15982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:24.578717 15977 server_base.cc:1034] running on GCE node
I20260808 07:07:24.579042 15977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:24.579309 15977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:24.580504 15977 hybrid_clock.cc:648] HybridClock initialized: now 1786172844580481 us; error 53 us; skew 500 ppm
Aug 08 07:07:24 dist-test-slave-77v9 krb5kdc[15862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172844, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:24.583410 15977 init.cc:377] Logged in from keytab as oryx/127.9.94.1@KRBTEST.COM (short username oryx)
I20260808 07:07:24.583899 15977 webserver.cc:460] Webserver started at http://127.9.94.1:39613/ using document root <none> and password file <none>
I20260808 07:07:24.584148 15977 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:24.584195 15977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:24.584326 15977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:24.585453 15977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "a21e18e8d94b480c885a3aabd893cfbe"
format_stamp: "Formatted at 2026-08-08 07:07:24 on dist-test-slave-77v9"
server_key: "96b24adc92cb14efe9f60684f6227064"
server_key_iv: "61a1a9b47cc39c0efaad72c26839c5c2"
server_key_version: "encryptionkey@0"
I20260808 07:07:24.585819 15977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "a21e18e8d94b480c885a3aabd893cfbe"
format_stamp: "Formatted at 2026-08-08 07:07:24 on dist-test-slave-77v9"
server_key: "96b24adc92cb14efe9f60684f6227064"
server_key_iv: "61a1a9b47cc39c0efaad72c26839c5c2"
server_key_version: "encryptionkey@0"
I20260808 07:07:24.587255 15977 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 07:07:24.588171 15993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:24.588446 15977 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:24.588559 15977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "a21e18e8d94b480c885a3aabd893cfbe"
format_stamp: "Formatted at 2026-08-08 07:07:24 on dist-test-slave-77v9"
server_key: "96b24adc92cb14efe9f60684f6227064"
server_key_iv: "61a1a9b47cc39c0efaad72c26839c5c2"
server_key_version: "encryptionkey@0"
I20260808 07:07:24.588639 15977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:24.596531 15977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:24.598932 15977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:24.599092 15977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:24.599349 15977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:24.599682 15977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:24.599717 15977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:24.599761 15977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:24.599785 15977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:24.606318 15977 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:38695
I20260808 07:07:24.606369 16114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:38695 every 8 connection(s)
I20260808 07:07:24.606875 15977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:07:24.613430 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 15977
I20260808 07:07:24.613732 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:24.613998 9592 external_mini_cluster.cc:1428] Setting key bc9860f6b8e13ec5c3dc2caedc085a4e
Aug 08 07:07:24 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172844, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
I20260808 07:07:24.618835 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:24.608071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:52019 (local address 127.9.94.62:45719)
0808 07:07:24.608157 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:24.608159 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:24.608187 (+ 28us) server_negotiation.cc:407] Connection header received
0808 07:07:24.608750 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:24.608752 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:24.608769 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:24.608953 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:24.609987 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:24.610551 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:24.611766 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:24.611987 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:24.612077 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:24.615023 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:24.615025 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:24.615025 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:24.615033 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:24.616920 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:24.617587 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:24.617588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:24.617588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:24.617645 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:24.618114 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:24.618115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:24.618115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:24.618234 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:24.618292 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:24.618670 (+ 378us) server_negotiation.cc:299] Negotiation successful
0808 07:07:24.618747 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 07:07:24.619148 16117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:24.607795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.1:52019)
0808 07:07:24.608057 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:24.608100 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:24.608613 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:24.609037 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:24.609041 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:24.609658 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:24.609863 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:24.609867 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:24.610678 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:24.610679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:24.611615 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:24.611617 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:24.612111 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:24.612112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:24.612223 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:24.612965 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:24.612974 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:24.614908 (+ 1934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:24.617055 (+ 2147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:24.617064 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:24.617067 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:24.617491 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:24.617716 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:24.617717 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:24.617718 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:24.617979 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:24.618306 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:24.618313 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:24.618525 (+ 212us) client_negotiation.cc:769] Sending connection context
0808 07:07:24.618651 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 07:07:24.618850 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":161,"threads_started":1}
I20260808 07:07:24.619750 16115 heartbeater.cc:347] Connected to a master server at 127.9.94.62:45719
I20260808 07:07:24.619853 16115 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:24.620057 16115 heartbeater.cc:511] Master 127.9.94.62:45719 requested a full tablet report, sending...
I20260808 07:07:24.620584 15910 ts_manager.cc:194] Registered new tserver with Master: a21e18e8d94b480c885a3aabd893cfbe (127.9.94.1:38695)
I20260808 07:07:24.621299 15910 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:52019
WARNING: no policy specified for oryx/127.9.94.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.2.keytab.
Entry for principal oryx/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.2.keytab.
I20260808 07:07:24.653891 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:45719
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.2.keytab
--principal=oryx/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:24.773746 16120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:24.774040 16120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:24.774067 16120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:24.775434 16120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:24.775480 16120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:24.775507 16120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:24.777482 16120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.2.keytab
--principal=oryx/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:45719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:24.777788 16120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:24.778074 16120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:24.783927 16126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:24.783964 16129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:24.784057 16120 server_base.cc:1034] running on GCE node
W20260808 07:07:24.784021 16125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:24.784405 16120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:24.784716 16120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:24.785902 16120 hybrid_clock.cc:648] HybridClock initialized: now 1786172844785831 us; error 99 us; skew 500 ppm
Aug 08 07:07:24 dist-test-slave-77v9 krb5kdc[15862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172844, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:24.789096 16120 init.cc:377] Logged in from keytab as oryx/127.9.94.2@KRBTEST.COM (short username oryx)
I20260808 07:07:24.789647 16120 webserver.cc:460] Webserver started at http://127.9.94.2:36097/ using document root <none> and password file <none>
I20260808 07:07:24.789916 16120 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:24.789989 16120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:24.790148 16120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:24.791271 16120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "bd63449a17f7409b8c30bb83298a571a"
format_stamp: "Formatted at 2026-08-08 07:07:24 on dist-test-slave-77v9"
server_key: "a3a2bc39cbc960e9bf0eb3cbe1113ae6"
server_key_iv: "9427a3799c068e3772b58d3ef9038178"
server_key_version: "encryptionkey@0"
I20260808 07:07:24.791669 16120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "bd63449a17f7409b8c30bb83298a571a"
format_stamp: "Formatted at 2026-08-08 07:07:24 on dist-test-slave-77v9"
server_key: "a3a2bc39cbc960e9bf0eb3cbe1113ae6"
server_key_iv: "9427a3799c068e3772b58d3ef9038178"
server_key_version: "encryptionkey@0"
I20260808 07:07:24.793393 16120 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260808 07:07:24.794461 16137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:24.794798 16120 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260808 07:07:24.794917 16120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "bd63449a17f7409b8c30bb83298a571a"
format_stamp: "Formatted at 2026-08-08 07:07:24 on dist-test-slave-77v9"
server_key: "a3a2bc39cbc960e9bf0eb3cbe1113ae6"
server_key_iv: "9427a3799c068e3772b58d3ef9038178"
server_key_version: "encryptionkey@0"
I20260808 07:07:24.794997 16120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:24.808396 16120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:24.810920 16120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:24.811120 16120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:24.811391 16120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:24.811774 16120 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:24.811831 16120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:24.811880 16120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:24.811903 16120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:24.820204 16120 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:40391
I20260808 07:07:24.820261 16254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:40391 every 8 connection(s)
I20260808 07:07:24.820660 16120 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:07:24.822209 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 16120
I20260808 07:07:24.822386 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:07:24.822654 9592 external_mini_cluster.cc:1428] Setting key 89889613e1e34ac3952499e1cb3b10cc
Aug 08 07:07:24 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172844, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
WARNING: no policy specified for oryx/127.9.94.3@KRBTEST.COM; defaulting to no policy
I20260808 07:07:24.834998 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:24.821542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:60553 (local address 127.9.94.62:45719)
0808 07:07:24.821639 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:24.821642 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:24.822294 (+ 652us) server_negotiation.cc:407] Connection header received
0808 07:07:24.823160 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:24.823161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:24.823175 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:24.823265 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:24.824906 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:24.825479 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:24.826835 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:24.827117 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:24.827186 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:24.830915 (+ 3729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:24.830917 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:24.830917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:24.830926 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:24.832745 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:24.833343 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:24.833345 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:24.833345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:24.833415 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:24.833872 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:24.833875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:24.833875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:24.834108 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:24.834225 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:24.834664 (+ 439us) server_negotiation.cc:299] Negotiation successful
0808 07:07:24.834911 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 07:07:24.835041 16257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:24.821474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.2:60553)
0808 07:07:24.821895 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:24.822001 (+ 106us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:24.823000 (+ 999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:24.823335 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:24.823339 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:24.824312 (+ 973us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:24.824660 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:24.824668 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:24.825634 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:24.825636 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:24.826713 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:24.826716 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:24.827251 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:24.827253 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:24.827431 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:24.828097 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:24.828110 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:24.830700 (+ 2590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:24.832943 (+ 2243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:24.832954 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:24.832957 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:24.833238 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:24.833521 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:24.833523 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:24.833523 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:24.833686 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:24.834286 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:24.834293 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:24.834471 (+ 178us) client_negotiation.cc:769] Sending connection context
0808 07:07:24.834588 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 07:07:24.834817 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":113,"threads_started":1}
I20260808 07:07:24.835904 16255 heartbeater.cc:347] Connected to a master server at 127.9.94.62:45719
I20260808 07:07:24.836072 16255 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:24.836304 16255 heartbeater.cc:511] Master 127.9.94.62:45719 requested a full tablet report, sending...
I20260808 07:07:24.837062 15910 ts_manager.cc:194] Registered new tserver with Master: bd63449a17f7409b8c30bb83298a571a (127.9.94.2:40391)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.94.3@KRBTEST.COM" created.
I20260808 07:07:24.837596 15910 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:60553
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.3.keytab.
Entry for principal oryx/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.3.keytab.
I20260808 07:07:24.857187 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:45719
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.3.keytab
--principal=oryx/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:24.946668 16260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:24.946884 16260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:24.946908 16260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:24.948084 16260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:24.948130 16260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:24.948156 16260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:24.949659 16260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.3.keytab
--principal=oryx/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:45719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:24.949860 16260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:24.950048 16260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:24.956007 16266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:24.955994 16269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:24.955994 16267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:24.956502 16260 server_base.cc:1034] running on GCE node
I20260808 07:07:24.956744 16260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:24.957055 16260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:24.958290 16260 hybrid_clock.cc:648] HybridClock initialized: now 1786172844958270 us; error 30 us; skew 500 ppm
Aug 08 07:07:24 dist-test-slave-77v9 krb5kdc[15862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172844, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:24.961460 16260 init.cc:377] Logged in from keytab as oryx/127.9.94.3@KRBTEST.COM (short username oryx)
I20260808 07:07:24.961951 16260 webserver.cc:460] Webserver started at http://127.9.94.3:43879/ using document root <none> and password file <none>
I20260808 07:07:24.962163 16260 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:24.962209 16260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:24.962313 16260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:24.963456 16260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "917200053dbe44b5a2894f29554f333c"
format_stamp: "Formatted at 2026-08-08 07:07:24 on dist-test-slave-77v9"
server_key: "d3023c933a233928d12a6e2984c302ba"
server_key_iv: "c70216e2a6202fa686d427dce7fb298b"
server_key_version: "encryptionkey@0"
I20260808 07:07:24.963836 16260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "917200053dbe44b5a2894f29554f333c"
format_stamp: "Formatted at 2026-08-08 07:07:24 on dist-test-slave-77v9"
server_key: "d3023c933a233928d12a6e2984c302ba"
server_key_iv: "c70216e2a6202fa686d427dce7fb298b"
server_key_version: "encryptionkey@0"
I20260808 07:07:24.966099 16260 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260808 07:07:24.967355 16277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:24.967778 16260 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260808 07:07:24.967934 16260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "917200053dbe44b5a2894f29554f333c"
format_stamp: "Formatted at 2026-08-08 07:07:24 on dist-test-slave-77v9"
server_key: "d3023c933a233928d12a6e2984c302ba"
server_key_iv: "c70216e2a6202fa686d427dce7fb298b"
server_key_version: "encryptionkey@0"
I20260808 07:07:24.968030 16260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:24.983278 16260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:24.986207 16260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:24.986388 16260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:24.986712 16260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:24.987043 16260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:24.987079 16260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:24.987103 16260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:24.987116 16260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:24.993916 16260 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:40387
I20260808 07:07:24.994017 16393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:40387 every 8 connection(s)
I20260808 07:07:24.994370 16260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:07:24 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172844, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
I20260808 07:07:25.004639 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 16260
I20260808 07:07:25.004760 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:07:25.005018 9592 external_mini_cluster.cc:1428] Setting key f92816b910091302fb004403aee92890
I20260808 07:07:25.005164 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:24.995160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:59861 (local address 127.9.94.62:45719)
0808 07:07:24.995258 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:24.995260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:24.995441 (+ 181us) server_negotiation.cc:407] Connection header received
0808 07:07:24.995959 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:24.995960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:24.995971 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:24.996045 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:24.997077 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:24.997701 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:24.998897 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:24.999193 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:24.999264 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.001904 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.001906 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.001906 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.001914 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.003413 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.003887 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.003888 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.003889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.003950 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.004257 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.004259 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.004259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.004402 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.004470 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.004977 (+ 507us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.005072 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 07:07:25.005734 16397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:24.995125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.3:59861)
0808 07:07:24.995297 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:24.995340 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:24.995866 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:24.996097 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:24.996100 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:24.996682 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:24.996982 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:24.996987 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:24.997864 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:24.997865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:24.998795 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:24.998797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:24.999313 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:24.999314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:24.999424 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:24.999973 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:24.999993 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.001759 (+ 1766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.003529 (+ 1770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.003537 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.003539 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.003784 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.004052 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.004053 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.004053 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.004167 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.004504 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.004512 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.004690 (+ 178us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.005315 (+ 625us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.005501 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":103,"threads_started":1}
I20260808 07:07:25.006261 16394 heartbeater.cc:347] Connected to a master server at 127.9.94.62:45719
I20260808 07:07:25.006392 16394 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:25.006633 16394 heartbeater.cc:511] Master 127.9.94.62:45719 requested a full tablet report, sending...
I20260808 07:07:25.007072 15909 ts_manager.cc:194] Registered new tserver with Master: 917200053dbe44b5a2894f29554f333c (127.9.94.3:40387)
I20260808 07:07:25.007457 15909 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:59861
I20260808 07:07:25.017540 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.9.94.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.94.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.94.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.61.keytab.
Entry for principal oryx/127.9.94.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.61.keytab.
I20260808 07:07:25.052744 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.61:46021
--webserver_interface=127.9.94.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.61.keytab
--principal=oryx/127.9.94.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:45719,127.9.94.61:46021
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:25.150313 16400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:25.150597 16400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:25.150641 16400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:25.151970 16400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:25.152038 16400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:25.152064 16400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:25.152096 16400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:25.152122 16400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:25.153954 16400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:45719,127.9.94.61:46021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.61.keytab
--principal=oryx/127.9.94.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.61:46021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.94.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
W20260808 07:07:25.154291 16400 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.9.94.62:45719,127.9.94.61:46021'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 07:07:25.154529 16400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:25.155020 16400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:25.160933 16408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:25.161103 16406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:25.161106 16405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:25.162911 16400 server_base.cc:1034] running on GCE node
I20260808 07:07:25.163242 16400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:25.163605 16400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:25.164901 16400 hybrid_clock.cc:648] HybridClock initialized: now 1786172845164802 us; error 50 us; skew 500 ppm
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:25.167835 16400 init.cc:377] Logged in from keytab as oryx/127.9.94.61@KRBTEST.COM (short username oryx)
I20260808 07:07:25.168387 16400 webserver.cc:460] Webserver started at http://127.9.94.61:46139/ using document root <none> and password file <none>
I20260808 07:07:25.168680 16400 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:25.168733 16400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:25.168922 16400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:25.170230 16400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/data/instance:
uuid: "6e83aed0f86b49f694c3d39e07a31c0d"
format_stamp: "Formatted at 2026-08-08 07:07:25 on dist-test-slave-77v9"
server_key: "da3dc8fe79f5cfa990aaf48645bac7d4"
server_key_iv: "3b7ac298b5b5a237a10f578b2aa4a03e"
server_key_version: "encryptionkey@0"
I20260808 07:07:25.170688 16400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/wal/instance:
uuid: "6e83aed0f86b49f694c3d39e07a31c0d"
format_stamp: "Formatted at 2026-08-08 07:07:25 on dist-test-slave-77v9"
server_key: "da3dc8fe79f5cfa990aaf48645bac7d4"
server_key_iv: "3b7ac298b5b5a237a10f578b2aa4a03e"
server_key_version: "encryptionkey@0"
I20260808 07:07:25.172526 16400 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:07:25.173950 16415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:25.174352 16400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:25.174449 16400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/wal
uuid: "6e83aed0f86b49f694c3d39e07a31c0d"
format_stamp: "Formatted at 2026-08-08 07:07:25 on dist-test-slave-77v9"
server_key: "da3dc8fe79f5cfa990aaf48645bac7d4"
server_key_iv: "3b7ac298b5b5a237a10f578b2aa4a03e"
server_key_version: "encryptionkey@0"
I20260808 07:07:25.174568 16400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:25.194502 16400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:25.197273 16400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:25.197475 16400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:25.202716 16400 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.61:46021
I20260808 07:07:25.202787 16472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.61:46021 every 8 connection(s)
I20260808 07:07:25.203151 16400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/data/info.pb
I20260808 07:07:25.204658 16473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:25.206494 16473 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:07:25.210250 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 16400
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.61@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.94.61@KRBTEST.COM
I20260808 07:07:25.218283 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.207300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53968 (local address 127.9.94.62:45719)
0808 07:07:25.207383 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.207385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.207636 (+ 251us) server_negotiation.cc:407] Connection header received
0808 07:07:25.208259 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.208261 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.208273 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.208352 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.209522 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.210084 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.211341 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.211665 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.211749 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.214345 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.214347 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.214347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.214365 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.216178 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.216674 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.216676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.216676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.216748 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.217215 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.217216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.217216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.217498 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.217606 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.218026 (+ 420us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.218152 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 07:07:25.218513 16475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.207251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.0.0.1:53968)
0808 07:07:25.207499 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.207540 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.208107 (+ 567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.208702 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.208705 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.209151 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.209386 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.209401 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.210203 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.210204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.211253 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.211255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.211780 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.211782 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.211926 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.212589 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.212598 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.214226 (+ 1628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.216313 (+ 2087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.216324 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.216327 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.216585 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.216912 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.216913 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.216913 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.217120 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.217641 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.217654 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.217802 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.217967 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.218175 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":137,"threads_started":1}
I20260808 07:07:25.219405 16473 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:07:25.220752 16477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.210818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53614 (local address 127.9.94.61:46021)
0808 07:07:25.211001 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.211007 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.211031 (+ 24us) server_negotiation.cc:407] Connection header received
0808 07:07:25.211079 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.211081 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.211102 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.211193 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.211944 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.212663 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.213499 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.213814 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.213891 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.216898 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.216907 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.216907 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.216916 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.219176 (+ 2260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.219697 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.219700 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.219700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.219759 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.220045 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.220045 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.220046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.220260 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.220440 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.220608 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.220675 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.61@KRBTEST.COM for oryx/127.9.94.61@KRBTEST.COM
I20260808 07:07:25.228148 16475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.219714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:46021 (local address 127.0.0.1:53628)
0808 07:07:25.219754 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.219767 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.219805 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.220160 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.220161 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.220333 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.220408 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.220411 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.221601 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.221602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.222128 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.222130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.222569 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.222570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.222648 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.223123 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.223128 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.224486 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.227073 (+ 2587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.227074 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.227075 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.227247 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.227446 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.227447 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.227447 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.227503 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.227849 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.227850 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.227894 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.227970 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.228071 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260808 07:07:25.228340 16478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.219804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53628 (local address 127.9.94.61:46021)
0808 07:07:25.220022 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.220024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.220032 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:07:25.220054 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.220055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.220066 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.220139 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.220512 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.221415 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.222236 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.222475 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.222569 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.224599 (+ 2030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.224600 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.224601 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.224608 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.226973 (+ 2365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.227324 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.227324 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.227325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.227383 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.227598 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.227599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.227599 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.227749 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.227829 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.228052 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.228138 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":136,"threads_started":1}
I20260808 07:07:25.229925 16473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: Bootstrap starting.
I20260808 07:07:25.230597 16473 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:25.230851 16473 log.cc:824] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:25.231674 16473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: No bootstrap required, opened a new log
I20260808 07:07:25.233271 16473 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } }
I20260808 07:07:25.233417 16473 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:25.233443 16473 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e83aed0f86b49f694c3d39e07a31c0d, State: Initialized, Role: FOLLOWER
I20260808 07:07:25.233582 16473 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } }
I20260808 07:07:25.233887 16480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } } }
I20260808 07:07:25.233956 16473 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:25.233991 16480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:07:25.235848 16491 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:07:25.235918 16491 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:07:25.238125 16400 master_runner.cc:428] Detected that this master 6e83aed0f86b49f694c3d39e07a31c0d is joining an existing cluster
I20260808 07:07:25.238197 16400 master_runner.cc:432] Initiating AddMaster RPC to add 127.9.94.61:46021
I20260808 07:07:25.247704 16498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.239670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:46021 (local address 127.0.0.1:53638)
0808 07:07:25.239880 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.239890 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.240099 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.240268 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.240269 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.240507 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.240576 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.240578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.241637 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.241638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.242463 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.242464 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.242928 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.242929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.243007 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.243654 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.243660 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.244144 (+ 484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.246365 (+ 2221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.246366 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.246366 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.246621 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.246893 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.246894 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.246895 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.246962 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.247292 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.247293 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.247339 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.247413 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.247576 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":81,"threads_started":1}
I20260808 07:07:25.247741 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.239472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53974 (local address 127.9.94.62:45719)
0808 07:07:25.239558 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.239561 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.239699 (+ 138us) server_negotiation.cc:407] Connection header received
0808 07:07:25.239832 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.239834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.239849 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.239921 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.240375 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.241135 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.242323 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.242660 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.242745 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.244056 (+ 1311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.244058 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.244059 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.244067 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.246004 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.246565 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.246566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.246567 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.246634 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.247099 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.247100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.247101 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.247232 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.247316 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.247563 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.247645 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 07:07:25.247896 16497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.239393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.0.0.1:53974)
0808 07:07:25.239627 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.239640 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.239730 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.239942 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.239943 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.240182 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.240267 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.240270 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.241222 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.241223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.242221 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.242224 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.242776 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.242777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.242841 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.243445 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.243451 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.243938 (+ 487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.246118 (+ 2180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.246119 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.246120 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.246469 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.246720 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.246721 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.246721 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.247039 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.247340 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.247341 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.247375 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.247472 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.247782 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":210,"thread_start_us":123,"threads_started":1}
I20260808 07:07:25.247977 16478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.239758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53638 (local address 127.9.94.61:46021)
0808 07:07:25.239804 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.239815 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.239937 (+ 122us) server_negotiation.cc:407] Connection header received
0808 07:07:25.240202 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.240203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.240215 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.240266 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.240672 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.241522 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.242545 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.242837 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.242910 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.244245 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.244246 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.244246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.244253 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.246284 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.246709 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.246710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.246711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.246796 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.247050 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.247051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.247051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.247206 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.247288 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.247461 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.247662 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":92,"server-negotiator.queue_time_us":23}
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172844, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.62@KRBTEST.COM for oryx/127.9.94.61@KRBTEST.COM
I20260808 07:07:25.258836 16478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.251096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53652 (local address 127.9.94.61:46021)
0808 07:07:25.251135 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.251137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.251296 (+ 159us) server_negotiation.cc:407] Connection header received
0808 07:07:25.251391 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.251391 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.251402 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.251459 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.251889 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.252419 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.253291 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.253497 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.253586 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.255856 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.255857 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.255857 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.255865 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.257395 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.257892 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.257893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.257894 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.257961 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.258187 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.258188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.258188 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.258322 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.258411 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.258619 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.258718 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:07:25.258855 16499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.251042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:46021 (local address 127.0.0.1:53652)
0808 07:07:25.251191 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.251233 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.251322 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.251467 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.251470 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.251754 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.251804 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.251806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.252519 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.252520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.253190 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.253192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.253573 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.253574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.253671 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.254225 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.254230 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.255738 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.257537 (+ 1799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.257546 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.257549 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.257787 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.258044 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.258045 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.258046 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.258114 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.258401 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.258410 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.258475 (+ 65us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.258588 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.258733 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
I20260808 07:07:25.259542 15909 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.9.94.61:46021: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d"
member_type: NON_VOTER
last_known_addr {
host: "127.9.94.61"
port: 46021
}
attrs {
promote: true
}
}
dest_uuid: "65c83b4dc8b749149b6ac835baeb7221"
cas_config_opid_index: -1
I20260808 07:07:25.259902 15909 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: NON_VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: true } }
I20260808 07:07:25.260450 16501 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 6e83aed0f86b49f694c3d39e07a31c0d (127.9.94.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: NON_VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: true } } }
I20260808 07:07:25.260898 16444 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:25.261765 16501 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.9.94.61:46021
I20260808 07:07:25.261870 16501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: NON_VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: true } } }
I20260808 07:07:25.261971 16501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:25.262006 16444 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 1 FOLLOWER]: Refusing update from remote peer 65c83b4dc8b749149b6ac835baeb7221: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 07:07:25.262405 16400 master.cc:537] Master@127.9.94.61:46021 shutting down...
I20260808 07:07:25.262392 16500 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: NON_VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 07:07:25.263191 15895 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 07:07:25.263808 15895 consensus_peers.cc:487] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 -> Peer 6e83aed0f86b49f694c3d39e07a31c0d (127.9.94.61:46021): Couldn't send request to peer 6e83aed0f86b49f694c3d39e07a31c0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 07:07:25.268712 16400 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:25.268872 16400 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:25.268944 16400 tablet_replica.cc:330] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: stopping tablet replica
I20260808 07:07:25.282013 16400 master.cc:552] Master@127.9.94.61:46021 shutdown complete.
I20260808 07:07:25.282107 16400 master_runner.cc:305] Clearing existing system tablet
I20260808 07:07:25.282258 16400 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:25.282343 16400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:25.283089 16400 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:07:25.283756 16505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:25.283950 16400 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:25.284024 16400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:25.284053 16400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/wal
uuid: "6e83aed0f86b49f694c3d39e07a31c0d"
format_stamp: "Formatted at 2026-08-08 07:07:25 on dist-test-slave-77v9"
server_key: "da3dc8fe79f5cfa990aaf48645bac7d4"
server_key_iv: "3b7ac298b5b5a237a10f578b2aa4a03e"
server_key_version: "encryptionkey@0"
I20260808 07:07:25.285064 16400 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:25.287858 16400 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 07:07:25.287974 16400 log.cc:1196] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 07:07:25.288213 16400 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: Deleting consensus metadata
I20260808 07:07:25.288506 16400 master_runner.cc:315] Copying system tablet from 127.9.94.62:45719
I20260808 07:07:25.289301 16400 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.94.62:45719
I20260808 07:07:25.298468 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.289775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53988 (local address 127.9.94.62:45719)
0808 07:07:25.289852 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.289855 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.289912 (+ 57us) server_negotiation.cc:407] Connection header received
0808 07:07:25.289974 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.289975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.289988 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.290068 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.290398 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.291543 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.292590 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.293092 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.293191 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.294902 (+ 1711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.294903 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.294904 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.294911 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.296774 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.297347 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.297348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.297349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.297416 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.297680 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.297681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.297681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.297961 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.298096 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.298308 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.298398 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 07:07:25.298524 16511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.289653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.0.0.1:53988)
0808 07:07:25.289841 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.289861 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.289922 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.290090 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.290090 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.290263 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.290322 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.290324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.291671 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.291672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.292487 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.292490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.293205 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.293206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.293272 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.294305 (+ 1033us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.294311 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.294787 (+ 476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.296974 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.296975 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.296976 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.297246 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.297502 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.297503 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.297504 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.297584 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.298096 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.298097 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.298154 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.298244 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.298381 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":98,"threads_started":1}
I20260808 07:07:25.299137 15931 tablet_copy_service.cc:140] P 65c83b4dc8b749149b6ac835baeb7221: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 6e83aed0f86b49f694c3d39e07a31c0d ({username='oryx', principal='oryx/127.9.94.61@KRBTEST.COM'} at 127.0.0.1:53988)
I20260808 07:07:25.299263 15931 tablet_copy_service.cc:161] P 65c83b4dc8b749149b6ac835baeb7221: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 6e83aed0f86b49f694c3d39e07a31c0d at {username='oryx', principal='oryx/127.9.94.61@KRBTEST.COM'} at 127.0.0.1:53988: session id = 6e83aed0f86b49f694c3d39e07a31c0d-00000000000000000000000000000000
I20260808 07:07:25.300220 15931 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 07:07:25.301283 16400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 07:07:25.302940 16400 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: tablet copy: Starting download of 0 data blocks...
I20260808 07:07:25.303234 16400 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: tablet copy: Starting download of 1 WAL segments...
I20260808 07:07:25.304894 16400 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 07:07:25.306541 15931 tablet_copy_service.cc:342] P 65c83b4dc8b749149b6ac835baeb7221: Request end of tablet copy session 6e83aed0f86b49f694c3d39e07a31c0d-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.9.94.61@KRBTEST.COM'} at 127.0.0.1:53988
I20260808 07:07:25.306623 15931 tablet_copy_service.cc:433] P 65c83b4dc8b749149b6ac835baeb7221: ending tablet copy session 6e83aed0f86b49f694c3d39e07a31c0d-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 6e83aed0f86b49f694c3d39e07a31c0d
I20260808 07:07:25.309742 16400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:25.311065 16512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:25.311096 16513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:25.311774 16515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:25.312077 16400 server_base.cc:1034] running on GCE node
I20260808 07:07:25.312230 16400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:25.312413 16400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:25.313575 16400 hybrid_clock.cc:648] HybridClock initialized: now 1786172845313558 us; error 36 us; skew 500 ppm
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:25.315231 16400 init.cc:377] Logged in from keytab as oryx/127.9.94.61@KRBTEST.COM (short username oryx)
I20260808 07:07:25.315606 16400 webserver.cc:460] Webserver started at http://127.9.94.61:43871/ using document root <none> and password file <none>
I20260808 07:07:25.315768 16400 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:25.315814 16400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:25.316617 16400 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:25.317291 16522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:25.317430 16400 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:25.317484 16400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/wal
uuid: "6e83aed0f86b49f694c3d39e07a31c0d"
format_stamp: "Formatted at 2026-08-08 07:07:25 on dist-test-slave-77v9"
server_key: "da3dc8fe79f5cfa990aaf48645bac7d4"
server_key_iv: "3b7ac298b5b5a237a10f578b2aa4a03e"
server_key_version: "encryptionkey@0"
I20260808 07:07:25.317550 16400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:25.325392 16400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:25.327361 16400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:25.331000 16400 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.61:46021
I20260808 07:07:25.331441 16576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.61:46021 every 8 connection(s)
I20260808 07:07:25.331533 16400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-1/data/info.pb
I20260808 07:07:25.332342 16577 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:07:25.332798 16577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: Bootstrap starting.
I20260808 07:07:25.335266 16577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:07:25.335530 16577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: Bootstrap complete.
I20260808 07:07:25.335775 16577 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: NON_VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: true } }
I20260808 07:07:25.335882 16577 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e83aed0f86b49f694c3d39e07a31c0d, State: Initialized, Role: LEARNER
I20260808 07:07:25.335912 16577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: NON_VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: true } }
I20260808 07:07:25.336112 16577 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:25.336133 16580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: NON_VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: true } } }
I20260808 07:07:25.336251 16580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: This master's current role is: LEARNER
I20260808 07:07:25.338539 16591 catalog_manager.cc:1259] Loaded cluster ID: c70e4f5dc2f34b0796410f72a3f1a7d0
I20260808 07:07:25.338618 16591 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: loading cluster ID for follower catalog manager: success
I20260808 07:07:25.339661 16591 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: acquiring CA information for follower catalog manager: success
I20260808 07:07:25.339958 16591 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:07:25.381618 16592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.373267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53668 (local address 127.9.94.61:46021)
0808 07:07:25.373438 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.373440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.373447 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:07:25.373472 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.373473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.373482 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.373554 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.374751 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.375516 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.376336 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.376534 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.376613 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.378239 (+ 1626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.378241 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.378241 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.378249 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.380241 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.380629 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.380630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.380631 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.380715 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.380965 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.380966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.380966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.381091 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.381211 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.381371 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.381464 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":90,"threads_started":1}
WARNING: no policy specified for oryx/127.9.94.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.94.60@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.94.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.60.keytab.
Entry for principal oryx/127.9.94.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.60.keytab.
I20260808 07:07:25.413789 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.60:45487
--webserver_interface=127.9.94.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.60.keytab
--principal=oryx/127.9.94.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:45719,127.9.94.61:46021,127.9.94.60:45487
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:25.511286 16595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:25.511564 16595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:25.511617 16595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:25.512934 16595 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:25.513006 16595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:25.513031 16595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:25.513064 16595 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:25.513092 16595 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:25.514756 16595 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:45719,127.9.94.61:46021,127.9.94.60:45487
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.60.keytab
--principal=oryx/127.9.94.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.60:45487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.94.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:25.515070 16595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:25.515326 16595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:25.521147 16600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:25.521169 16604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:25.521167 16601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:25.521533 16595 server_base.cc:1034] running on GCE node
I20260808 07:07:25.521813 16595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:25.522104 16595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:25.523252 16595 hybrid_clock.cc:648] HybridClock initialized: now 1786172845523213 us; error 55 us; skew 500 ppm
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:25.525966 16595 init.cc:377] Logged in from keytab as oryx/127.9.94.60@KRBTEST.COM (short username oryx)
I20260808 07:07:25.526474 16595 webserver.cc:460] Webserver started at http://127.9.94.60:43271/ using document root <none> and password file <none>
I20260808 07:07:25.526669 16595 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:25.526711 16595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:25.526809 16595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:25.527908 16595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/data/instance:
uuid: "7b531398de4348b1901b6b063033f0cd"
format_stamp: "Formatted at 2026-08-08 07:07:25 on dist-test-slave-77v9"
server_key: "f8008047ec4624231a3aa5c1def5957b"
server_key_iv: "dd885208013399c0f8790562dfea8b5d"
server_key_version: "encryptionkey@0"
I20260808 07:07:25.528424 16595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/wal/instance:
uuid: "7b531398de4348b1901b6b063033f0cd"
format_stamp: "Formatted at 2026-08-08 07:07:25 on dist-test-slave-77v9"
server_key: "f8008047ec4624231a3aa5c1def5957b"
server_key_iv: "dd885208013399c0f8790562dfea8b5d"
server_key_version: "encryptionkey@0"
I20260808 07:07:25.529912 16595 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:07:25.530793 16613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:25.531036 16595 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:25.531163 16595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/wal
uuid: "7b531398de4348b1901b6b063033f0cd"
format_stamp: "Formatted at 2026-08-08 07:07:25 on dist-test-slave-77v9"
server_key: "f8008047ec4624231a3aa5c1def5957b"
server_key_iv: "dd885208013399c0f8790562dfea8b5d"
server_key_version: "encryptionkey@0"
I20260808 07:07:25.531251 16595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:25.560376 16595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:25.563423 16595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:25.563627 16595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:25.569155 16595 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.60:45487
I20260808 07:07:25.569212 16666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.60:45487 every 8 connection(s)
I20260808 07:07:25.569624 16595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/data/info.pb
I20260808 07:07:25.570714 16667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:25.571359 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 16595
I20260808 07:07:25.572949 16667 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.60@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.94.60@KRBTEST.COM
I20260808 07:07:25.583230 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.573676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54004 (local address 127.9.94.62:45719)
0808 07:07:25.573755 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.573757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.573845 (+ 88us) server_negotiation.cc:407] Connection header received
0808 07:07:25.573880 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.573881 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.573898 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.573963 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.574400 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.575115 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.576476 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.576764 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.576874 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.579477 (+ 2603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.579479 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.579479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.579488 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.581558 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.582021 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.582022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.582023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.582094 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.582413 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.582414 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.582414 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.582564 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.582643 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.583020 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.583112 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 07:07:25.583343 16670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.573560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.0.0.1:54004)
0808 07:07:25.573755 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.573784 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.573839 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.573975 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.573976 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.574213 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.574307 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.574311 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.575226 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.575227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.576385 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.576388 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.576899 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.576900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.576985 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.577490 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.577501 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.579370 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.581645 (+ 2275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.581651 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.581653 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.581937 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.582175 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.582175 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.582176 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.582333 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.582639 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.582644 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.582855 (+ 211us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.582962 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.583086 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":75,"threads_started":1}
I20260808 07:07:25.583833 16669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.572008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59238 (local address 127.9.94.60:45487)
0808 07:07:25.572197 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.572205 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.572230 (+ 25us) server_negotiation.cc:407] Connection header received
0808 07:07:25.572712 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.572720 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.572768 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.572984 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.573655 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.574937 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.576179 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.576606 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.576722 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.580088 (+ 3366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.580096 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.580097 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.580105 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.582201 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.582584 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.582587 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.582588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.582653 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.582909 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.582910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.582911 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.583117 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.583270 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.583622 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.583699 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":82,"threads_started":1}
I20260808 07:07:25.583986 16667 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.60@KRBTEST.COM for oryx/127.9.94.61@KRBTEST.COM
I20260808 07:07:25.591413 16670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.584259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:46021 (local address 127.0.0.1:53682)
0808 07:07:25.584311 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.584322 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.584358 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.584559 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.584559 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.584671 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.584716 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.584718 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.585375 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.585376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.585893 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.585894 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.586304 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.586305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.586369 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.586796 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.586800 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.588301 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.590159 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.590160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.590161 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.590380 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.590623 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.590623 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.590623 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.590684 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.591085 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.591087 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.591131 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.591226 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.591321 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 07:07:25.591464 16592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.584349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53682 (local address 127.9.94.61:46021)
0808 07:07:25.584400 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.584402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.584432 (+ 30us) server_negotiation.cc:407] Connection header received
0808 07:07:25.584466 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.584467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.584476 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.584554 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.584768 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.585311 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.585969 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.586169 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.586242 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.588468 (+ 2226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.588470 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.588470 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.588479 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.590041 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.590479 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.590481 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.590481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.590544 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.590853 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.590856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.590856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.590984 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.591056 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.591292 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.591398 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:07:25.592101 16667 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.60@KRBTEST.COM for oryx/127.9.94.60@KRBTEST.COM
I20260808 07:07:25.600121 16669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.592504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59252 (local address 127.9.94.60:45487)
0808 07:07:25.592573 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.592574 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.592581 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:07:25.592604 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.592605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.592611 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.592669 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.593020 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.593516 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.594176 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.594382 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.594457 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.596418 (+ 1961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.596419 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.596420 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.596427 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.598649 (+ 2222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.599166 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.599167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.599167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.599224 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.599439 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.599439 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.599439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.599562 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.599621 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.599943 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.600051 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 07:07:25.600274 16670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.592405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:45487 (local address 127.0.0.1:59252)
0808 07:07:25.592461 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.592472 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.592511 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.592683 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.592684 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.592890 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.592932 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.592934 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.593619 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.593620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.594087 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.594088 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.594453 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.594454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.594500 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.594953 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.594958 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.596291 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.598826 (+ 2535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.598829 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.598830 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.599074 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.599306 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.599307 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.599307 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.599374 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.599699 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.599701 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.599775 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.599902 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.600138 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":81}
I20260808 07:07:25.602259 16667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: Bootstrap starting.
I20260808 07:07:25.603075 16667 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:25.603307 16667 log.cc:824] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:25.604056 16667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: No bootstrap required, opened a new log
I20260808 07:07:25.605556 16667 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } }
I20260808 07:07:25.605696 16667 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:25.605720 16667 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b531398de4348b1901b6b063033f0cd, State: Initialized, Role: FOLLOWER
I20260808 07:07:25.605860 16667 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } }
I20260808 07:07:25.606113 16672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } } }
I20260808 07:07:25.606199 16672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:07:25.606220 16667 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [sys.catalog]: configured and running, proceeding with master startup.
W20260808 07:07:25.608155 16684 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:07:25.608438 16684 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:07:25.611275 16595 master_runner.cc:428] Detected that this master 7b531398de4348b1901b6b063033f0cd is joining an existing cluster
I20260808 07:07:25.611325 16595 master_runner.cc:432] Initiating AddMaster RPC to add 127.9.94.60:45487
I20260808 07:07:25.620327 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.612891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54012 (local address 127.9.94.62:45719)
0808 07:07:25.612949 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.612952 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.613158 (+ 206us) server_negotiation.cc:407] Connection header received
0808 07:07:25.613188 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.613189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.613200 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.613261 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.613954 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.614781 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.615664 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.615936 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.616012 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.617163 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.617165 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.617166 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.617174 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.619020 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.619468 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.619469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.619470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.619532 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.619754 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.619755 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.619755 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.619886 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.619928 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.620131 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.620212 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:07:25.620714 16690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.612863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.0.0.1:54012)
0808 07:07:25.613034 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.613046 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.613119 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.613409 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.613410 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.613764 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.613837 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.613840 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.614878 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.614879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.615565 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.615568 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.616026 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.616027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.616086 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.616603 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.616608 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.617083 (+ 475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.619104 (+ 2021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.619105 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.619106 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.619392 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.619614 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.619615 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.619615 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.619682 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.619978 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.619978 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.620021 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.620497 (+ 476us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.620605 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":4,"thread_start_us":89,"threads_started":1}
I20260808 07:07:25.623127 16115 heartbeater.cc:503] Master 127.9.94.62:45719 was elected leader, sending a full tablet report...
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172844, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.62@KRBTEST.COM for oryx/127.9.94.60@KRBTEST.COM
I20260808 07:07:25.635553 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 15977
I20260808 07:07:25.640195 16592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.613331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53694 (local address 127.9.94.61:46021)
0808 07:07:25.613375 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.613377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.617085 (+ 3708us) server_negotiation.cc:407] Connection header received
0808 07:07:25.617493 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.617494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.617507 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.617567 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.618514 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.619188 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.620177 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.620424 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.620494 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.621610 (+ 1116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.621611 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.621611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.621620 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.623427 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.638912 (+ 15485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.638914 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.638915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.639012 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.639282 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.639283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.639284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.639496 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.639584 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.639880 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.640014 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:07:25.641094 16691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.613125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:46021 (local address 127.0.0.1:53694)
0808 07:07:25.617002 (+ 3877us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.617012 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.617097 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.617624 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.617625 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.617877 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.618402 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.618405 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.619471 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.619472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.620075 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.620076 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.620559 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.620560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.620623 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.621128 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.621133 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.621513 (+ 380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.623514 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.623515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.623515 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.638745 (+ 15230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.639103 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.639104 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.639105 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.639181 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.639629 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.639630 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.639701 (+ 71us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.640655 (+ 954us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.640881 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3860,"thread_start_us":74,"threads_started":1}
I20260808 07:07:25.645974 16669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.613281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59254 (local address 127.9.94.60:45487)
0808 07:07:25.613320 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.613322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.613343 (+ 21us) server_negotiation.cc:407] Connection header received
0808 07:07:25.613363 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.613364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.613372 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.613453 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.613928 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.614761 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.615923 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.616173 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.616267 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.642175 (+ 25908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.642177 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.642177 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.642185 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.644124 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.645047 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.645048 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.645049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.645115 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.645313 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.645313 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.645314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.645482 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.645540 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.645720 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.645814 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:07:25.646409 16692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.612871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:45487 (local address 127.0.0.1:59254)
0808 07:07:25.613240 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.613251 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.613297 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.613458 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.613459 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.613744 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.613833 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.613835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.614855 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.614856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.615830 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.615833 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.616271 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.616272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.616348 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.641601 (+ 25253us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.641607 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.642055 (+ 448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.644235 (+ 2180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.644236 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.644237 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.644627 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.645187 (+ 560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.645188 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.645188 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.645249 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.645572 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.645573 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.645613 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.646115 (+ 502us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.646242 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":33,"spinlock_wait_cycles":8960,"thread_start_us":118,"threads_started":1}
I20260808 07:07:25.647548 16693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.624427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59270 (local address 127.9.94.60:45487)
0808 07:07:25.624607 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.624609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.624614 (+ 5us) server_negotiation.cc:407] Connection header received
0808 07:07:25.624643 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.624644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.624658 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.624737 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.625097 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.625603 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.626302 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.626523 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.626597 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.629198 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.629200 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.629201 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.629211 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.645709 (+ 16498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.646212 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.646213 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.646213 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.646292 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.646546 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.646547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.646548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.647042 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.647116 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.647337 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.647430 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":122,"threads_started":1}
I20260808 07:07:25.647569 16499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.624352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:45487 (local address 127.0.0.1:59270)
0808 07:07:25.624435 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.624446 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.624486 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.624742 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.624743 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.624961 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.625006 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.625008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.625703 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.625704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.626212 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.626214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.626610 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.626612 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.626687 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.627125 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.627130 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.628993 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.645847 (+ 16854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.645848 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.645849 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.646120 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.646375 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.646376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.646376 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.646462 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.647133 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.647135 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.647197 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.647284 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.647432 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 07:07:25.647644 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:38695
--local_ip_for_outbound_sockets=127.9.94.1
--tserver_master_addrs=127.9.94.62:45719
--webserver_port=39613
--webserver_interface=127.9.94.1
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.1.keytab
--principal=oryx/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.94.62:45719,127.9.94.61:46021
--tserver_master_addrs=127.9.94.62:45719,127.9.94.61:46021,127.9.94.60:45487 with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:07:25.648077 15909 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.9.94.60:45487: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7b531398de4348b1901b6b063033f0cd"
member_type: NON_VOTER
last_known_addr {
host: "127.9.94.60"
port: 45487
}
attrs {
promote: true
}
}
dest_uuid: "65c83b4dc8b749149b6ac835baeb7221"
cas_config_opid_index: 5
I20260808 07:07:25.648351 15909 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: NON_VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: true } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } }
I20260808 07:07:25.648774 16500 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 7b531398de4348b1901b6b063033f0cd (127.9.94.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: NON_VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: true } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } } }
I20260808 07:07:25.649381 16640 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:25.650233 16500 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.9.94.60:45487
I20260808 07:07:25.650331 16500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: NON_VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: true } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } } }
I20260808 07:07:25.650388 16640 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 1 FOLLOWER]: Refusing update from remote peer 65c83b4dc8b749149b6ac835baeb7221: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 07:07:25.650408 16500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:25.650732 16595 master.cc:537] Master@127.9.94.60:45487 shutting down...
I20260808 07:07:25.650725 16501 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 07:07:25.652482 15896 consensus_peers.cc:487] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 -> Peer 7b531398de4348b1901b6b063033f0cd (127.9.94.60:45487): Couldn't send request to peer 7b531398de4348b1901b6b063033f0cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 07:07:25.655546 16595 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:25.655658 16595 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:25.655715 16595 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: stopping tablet replica
I20260808 07:07:25.657361 16499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.648919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:46021 (local address 127.0.0.1:53696)
0808 07:07:25.652955 (+ 4036us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.652970 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.653038 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.653435 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.653436 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.653438 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:25.653510 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.653513 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.654541 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.654542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.655999 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.656003 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.656996 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.656997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.657082 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.657116 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.657179 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.657240 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4009}
I20260808 07:07:25.657764 16592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.649026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53696 (local address 127.9.94.61:46021)
0808 07:07:25.650570 (+ 1544us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.650573 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.653188 (+ 2615us) server_negotiation.cc:407] Connection header received
0808 07:07:25.653231 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.653233 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.653276 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.653342 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:25.653597 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.654427 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.656086 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.656749 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.656873 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.656953 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.657619 (+ 666us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.657676 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1514}
I20260808 07:07:25.658311 16551 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 1 LEARNER]: Refusing update from remote peer 65c83b4dc8b749149b6ac835baeb7221: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 07:07:25.658628 16501 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: NON_VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 07:07:25.659368 16595 master.cc:552] Master@127.9.94.60:45487 shutdown complete.
I20260808 07:07:25.659420 16595 master_runner.cc:305] Clearing existing system tablet
I20260808 07:07:25.659339 16551 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 7b531398de4348b1901b6b063033f0cd (127.9.94.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: NON_VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: true } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } } }
I20260808 07:07:25.659569 16595 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:25.659618 16595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:25.660547 16595 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:25.661062 16698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:25.661013 16580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65c83b4dc8b749149b6ac835baeb7221. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: NON_VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: true } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } } }
I20260808 07:07:25.661116 16580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: This master's current role is: LEARNER
I20260808 07:07:25.661150 16595 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:25.661187 16595 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:25.661167 16580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: NON_VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: true } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } } }
I20260808 07:07:25.661209 16595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/wal
uuid: "7b531398de4348b1901b6b063033f0cd"
format_stamp: "Formatted at 2026-08-08 07:07:25 on dist-test-slave-77v9"
server_key: "f8008047ec4624231a3aa5c1def5957b"
server_key_iv: "dd885208013399c0f8790562dfea8b5d"
server_key_version: "encryptionkey@0"
I20260808 07:07:25.661231 16580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: This master's current role is: LEARNER
I20260808 07:07:25.662015 16595 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:25.663837 16595 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 07:07:25.663918 16595 log.cc:1196] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 07:07:25.664151 16595 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: Deleting consensus metadata
I20260808 07:07:25.664305 16595 master_runner.cc:315] Copying system tablet from 127.9.94.62:45719
I20260808 07:07:25.665081 16595 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: tablet copy: Beginning tablet copy session from remote peer at address 127.9.94.62:45719
I20260808 07:07:25.665634 16501 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221: attempting to promote NON_VOTER 6e83aed0f86b49f694c3d39e07a31c0d to VOTER
I20260808 07:07:25.665885 16501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } }
I20260808 07:07:25.666414 16551 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 1 LEARNER]: Refusing update from remote peer 65c83b4dc8b749149b6ac835baeb7221: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 07:07:25.666555 16499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.666411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:45487 (local address 127.0.0.1:59276)
0808 07:07:25.666474 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.666518 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:45487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 07:07:25.666854 16499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.666776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:45487 (local address 127.0.0.1:59284)
0808 07:07:25.666812 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.666833 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:45487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 07:07:25.666704 16500 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260808 07:07:25.666917 15896 consensus_peers.cc:487] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 -> Peer 7b531398de4348b1901b6b063033f0cd (127.9.94.60:45487): Couldn't send request to peer 7b531398de4348b1901b6b063033f0cd. Status: Network error: Client connection negotiation failed: client connection to 127.9.94.60:45487: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 07:07:25.667676 16500 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 6e83aed0f86b49f694c3d39e07a31c0d (127.9.94.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } } }
I20260808 07:07:25.668910 16500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } } }
I20260808 07:07:25.668994 16500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:25.669482 16501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } } }
I20260808 07:07:25.669559 16501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:25.669909 16551 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 6e83aed0f86b49f694c3d39e07a31c0d (127.9.94.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } } }
I20260808 07:07:25.671173 16697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } } }
I20260808 07:07:25.671288 16697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:07:25.675087 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.665554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54022 (local address 127.9.94.62:45719)
0808 07:07:25.666275 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.666277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.667100 (+ 823us) server_negotiation.cc:407] Connection header received
0808 07:07:25.667207 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.667207 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.667219 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.667251 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.667728 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.668602 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.669830 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.670159 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.670205 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.671580 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.671581 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.671582 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.671590 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.673643 (+ 2053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.674105 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.674106 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.674107 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.674168 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.674403 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.674404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.674405 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.674551 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.674598 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.674832 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.674967 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":683}
I20260808 07:07:25.675437 16705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.665386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.0.0.1:54022)
0808 07:07:25.667031 (+ 1645us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.667043 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.667129 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.667334 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.667335 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.667559 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.667631 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.667633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.668710 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.668710 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.669718 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.669721 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.670303 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.670304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.670374 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.670956 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.670962 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.671419 (+ 457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.673751 (+ 2332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.673752 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.673752 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.673990 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.674247 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.674248 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.674248 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.674322 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.674653 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.674654 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.674704 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.675177 (+ 473us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.675313 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1622,"thread_start_us":71,"threads_started":1}
I20260808 07:07:25.675705 15931 tablet_copy_service.cc:140] P 65c83b4dc8b749149b6ac835baeb7221: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7b531398de4348b1901b6b063033f0cd ({username='oryx', principal='oryx/127.9.94.60@KRBTEST.COM'} at 127.0.0.1:54022)
I20260808 07:07:25.675767 15931 tablet_copy_service.cc:161] P 65c83b4dc8b749149b6ac835baeb7221: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7b531398de4348b1901b6b063033f0cd at {username='oryx', principal='oryx/127.9.94.60@KRBTEST.COM'} at 127.0.0.1:54022: session id = 7b531398de4348b1901b6b063033f0cd-00000000000000000000000000000000
I20260808 07:07:25.676504 15931 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 07:07:25.678131 16595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 07:07:25.679600 16595 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: tablet copy: Starting download of 0 data blocks...
I20260808 07:07:25.679775 16595 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: tablet copy: Starting download of 1 WAL segments...
I20260808 07:07:25.680615 16595 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 07:07:25.681730 15931 tablet_copy_service.cc:342] P 65c83b4dc8b749149b6ac835baeb7221: Request end of tablet copy session 7b531398de4348b1901b6b063033f0cd-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.9.94.60@KRBTEST.COM'} at 127.0.0.1:54022
I20260808 07:07:25.681798 15931 tablet_copy_service.cc:433] P 65c83b4dc8b749149b6ac835baeb7221: ending tablet copy session 7b531398de4348b1901b6b063033f0cd-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7b531398de4348b1901b6b063033f0cd
I20260808 07:07:25.684754 16595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:25.685974 16712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:25.686296 16709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:25.686650 16595 server_base.cc:1034] running on GCE node
W20260808 07:07:25.686616 16710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:25.686810 16595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:25.686964 16595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:25.688082 16595 hybrid_clock.cc:648] HybridClock initialized: now 1786172845688092 us; error 47 us; skew 500 ppm
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:25.689855 16595 init.cc:377] Logged in from keytab as oryx/127.9.94.60@KRBTEST.COM (short username oryx)
I20260808 07:07:25.690181 16595 webserver.cc:460] Webserver started at http://127.9.94.60:41985/ using document root <none> and password file <none>
I20260808 07:07:25.690348 16595 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:25.690392 16595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:25.691268 16595 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:25.691962 16719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:25.692152 16595 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:07:25.692210 16595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/wal
uuid: "7b531398de4348b1901b6b063033f0cd"
format_stamp: "Formatted at 2026-08-08 07:07:25 on dist-test-slave-77v9"
server_key: "f8008047ec4624231a3aa5c1def5957b"
server_key_iv: "dd885208013399c0f8790562dfea8b5d"
server_key_version: "encryptionkey@0"
I20260808 07:07:25.692286 16595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:25.732467 16595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:25.734539 16595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:25.738117 16595 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.60:45487
I20260808 07:07:25.738298 16772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.60:45487 every 8 connection(s)
I20260808 07:07:25.738641 16595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/master-2/data/info.pb
I20260808 07:07:25.739881 16773 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:07:25.740474 16773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: Bootstrap starting.
I20260808 07:07:25.744293 16773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:07:25.744650 16773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: Bootstrap complete.
I20260808 07:07:25.745172 16773 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } }
I20260808 07:07:25.745293 16773 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7b531398de4348b1901b6b063033f0cd, State: Initialized, Role: LEARNER
I20260808 07:07:25.745524 16773 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } }
I20260808 07:07:25.745772 16773 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:25.745745 16776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } } }
I20260808 07:07:25.746021 16776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [sys.catalog]: This master's current role is: LEARNER
I20260808 07:07:25.748759 16788 catalog_manager.cc:1259] Loaded cluster ID: c70e4f5dc2f34b0796410f72a3f1a7d0
I20260808 07:07:25.748871 16788 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: loading cluster ID for follower catalog manager: success
I20260808 07:07:25.749943 16788 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: acquiring CA information for follower catalog manager: success
I20260808 07:07:25.750242 16788 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 07:07:25.765718 16694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:25.765949 16694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:25.765974 16694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:25.767467 16694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:25.767542 16694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:25.767576 16694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:25.769403 16694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.1.keytab
--principal=oryx/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:38695
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=39613
--tserver_master_addrs=127.9.94.62:45719,127.9.94.61:46021,127.9.94.60:45487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:25.769692 16694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:25.769995 16694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:25.775746 16794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:25.775864 16796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:25.775746 16793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:25.776172 16694 server_base.cc:1034] running on GCE node
I20260808 07:07:25.776453 16694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:25.776765 16694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:25.778025 16694 hybrid_clock.cc:648] HybridClock initialized: now 1786172845778006 us; error 35 us; skew 500 ppm
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:25.781165 16694 init.cc:377] Logged in from keytab as oryx/127.9.94.1@KRBTEST.COM (short username oryx)
I20260808 07:07:25.781728 16694 webserver.cc:460] Webserver started at http://127.9.94.1:39613/ using document root <none> and password file <none>
I20260808 07:07:25.781991 16694 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:25.782094 16694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:25.783944 16694 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 07:07:25.784680 16803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:25.784900 16694 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:07:25.785008 16694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "a21e18e8d94b480c885a3aabd893cfbe"
format_stamp: "Formatted at 2026-08-08 07:07:24 on dist-test-slave-77v9"
server_key: "96b24adc92cb14efe9f60684f6227064"
server_key_iv: "61a1a9b47cc39c0efaad72c26839c5c2"
server_key_version: "encryptionkey@0"
I20260808 07:07:25.785408 16694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:25.798660 16694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:25.801539 16694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:25.801724 16694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:25.802024 16694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:25.802363 16694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:25.802419 16694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:25.802462 16694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:25.802495 16694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:25.808755 16694 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:38695
I20260808 07:07:25.808899 16922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:38695 every 8 connection(s)
I20260808 07:07:25.809243 16694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:07:25.815335 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 16694
I20260808 07:07:25.815526 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 16120
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.61@KRBTEST.COM
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.60@KRBTEST.COM
I20260808 07:07:25.824185 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.810093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:49975 (local address 127.9.94.62:45719)
0808 07:07:25.810147 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.810150 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.810572 (+ 422us) server_negotiation.cc:407] Connection header received
0808 07:07:25.811056 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.811057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.811071 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.811131 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.812936 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.813468 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.814646 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.814908 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.814975 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.819464 (+ 4489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.819466 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.819467 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.819476 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.822541 (+ 3065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.823043 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.823044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.823045 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.823112 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.823346 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.823347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.823348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.823503 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.823554 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.823985 (+ 431us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.824078 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:07:25.824430 16930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.810089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:45487 (local address 127.9.94.1:59309)
0808 07:07:25.810569 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.810580 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.810988 (+ 408us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.811267 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.811268 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.811806 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.812096 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.812102 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.814901 (+ 2799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.814902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.815855 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.815858 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.816449 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.816450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.816523 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.817033 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.817039 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.820123 (+ 3084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.822416 (+ 2293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.822428 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.822431 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.822831 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.823093 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.823094 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.823094 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.823254 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.823604 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.823611 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.823804 (+ 193us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.823935 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.824130 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"mutex_wait_us":27,"spinlock_wait_cycles":768,"thread_start_us":106,"threads_started":1}
I20260808 07:07:25.824476 16592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.810506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:34493 (local address 127.9.94.61:46021)
0808 07:07:25.810552 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.810554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.811223 (+ 669us) server_negotiation.cc:407] Connection header received
0808 07:07:25.811253 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.811254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.811267 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.811324 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.812207 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.812775 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.814837 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.815142 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.815209 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.820483 (+ 5274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.820485 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.820486 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.820496 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.822821 (+ 2325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.823341 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.823342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.823343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.823415 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.823675 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.823676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.823676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.823872 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.823927 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.824197 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.824330 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:07:25.824922 16927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.810089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.1:49975)
0808 07:07:25.810287 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.810323 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.810943 (+ 620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.811263 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.811267 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.811802 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.812096 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.812102 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.813563 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.813564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.814524 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.814527 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.815007 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.815008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.815159 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.816073 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.816084 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.819277 (+ 3193us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.822634 (+ 3357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.822635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.822635 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.822946 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.823195 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.823195 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.823196 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.823262 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.823609 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.823613 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.823826 (+ 213us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.824407 (+ 581us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.824763 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":75,"thread_start_us":107,"threads_started":1}
I20260808 07:07:25.825119 16928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.810417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:46021 (local address 127.9.94.1:34493)
0808 07:07:25.811135 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.811146 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.811198 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.811396 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.811397 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.811824 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.812096 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.812102 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.813611 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.813612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.814727 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.814730 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.815268 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.815269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.815338 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.816317 (+ 979us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.816323 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.820349 (+ 4026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.822933 (+ 2584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.822934 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.822935 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.823233 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.823505 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.823506 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.823506 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.823586 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.823985 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.823986 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.824046 (+ 60us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.824587 (+ 541us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.824911 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":703,"mutex_wait_us":143,"thread_start_us":73,"threads_started":1}
I20260808 07:07:25.825127 16929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.810370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:59309 (local address 127.9.94.60:45487)
0808 07:07:25.810530 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.810532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.810661 (+ 129us) server_negotiation.cc:407] Connection header received
0808 07:07:25.811131 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.811132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.811147 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.811264 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.813648 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.814771 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.815968 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.816307 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.816387 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.820249 (+ 3862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.820250 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.820251 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.820261 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.822287 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.822927 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.822928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.822928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.822998 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.823351 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.823352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.823353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.823504 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.823571 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.824863 (+ 1292us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.824971 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":85,"threads_started":1}
I20260808 07:07:25.825730 16923 heartbeater.cc:347] Connected to a master server at 127.9.94.60:45487
I20260808 07:07:25.825870 16923 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:25.825928 16925 heartbeater.cc:347] Connected to a master server at 127.9.94.61:46021
I20260808 07:07:25.825995 16925 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:25.826118 16923 heartbeater.cc:511] Master 127.9.94.60:45487 requested a full tablet report, sending...
I20260808 07:07:25.826122 16925 heartbeater.cc:511] Master 127.9.94.61:46021 requested a full tablet report, sending...
I20260808 07:07:25.826753 16736 ts_manager.cc:194] Registered new tserver with Master: a21e18e8d94b480c885a3aabd893cfbe (127.9.94.1:38695)
I20260808 07:07:25.826836 16541 ts_manager.cc:194] Registered new tserver with Master: a21e18e8d94b480c885a3aabd893cfbe (127.9.94.1:38695)
I20260808 07:07:25.829391 16924 heartbeater.cc:347] Connected to a master server at 127.9.94.62:45719
I20260808 07:07:25.829463 16924 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:25.829550 16924 heartbeater.cc:511] Master 127.9.94.62:45719 requested a full tablet report, sending...
I20260808 07:07:25.829874 15909 ts_manager.cc:194] Re-registered known tserver with Master: a21e18e8d94b480c885a3aabd893cfbe (127.9.94.1:38695)
I20260808 07:07:25.830288 15909 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:49975
I20260808 07:07:25.833792 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:40391
--local_ip_for_outbound_sockets=127.9.94.2
--tserver_master_addrs=127.9.94.62:45719
--webserver_port=36097
--webserver_interface=127.9.94.2
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.2.keytab
--principal=oryx/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.94.62:45719,127.9.94.61:46021
--tserver_master_addrs=127.9.94.62:45719,127.9.94.61:46021,127.9.94.60:45487 with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:25.927686 16931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:25.928030 16931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:25.928084 16931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:25.930624 16931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:25.930722 16931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:25.930775 16931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:25.932704 16931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.2.keytab
--principal=oryx/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:40391
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=36097
--tserver_master_addrs=127.9.94.62:45719,127.9.94.61:46021,127.9.94.60:45487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16931
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:25.933089 16931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:25.933357 16931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:25.939610 16940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:25.939610 16937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:25.939642 16938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:25.940084 16931 server_base.cc:1034] running on GCE node
I20260808 07:07:25.940410 16931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:25.940714 16931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:25.941993 16931 hybrid_clock.cc:648] HybridClock initialized: now 1786172845942014 us; error 70 us; skew 500 ppm
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:25.945127 16931 init.cc:377] Logged in from keytab as oryx/127.9.94.2@KRBTEST.COM (short username oryx)
I20260808 07:07:25.945643 16931 webserver.cc:460] Webserver started at http://127.9.94.2:36097/ using document root <none> and password file <none>
I20260808 07:07:25.945911 16931 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:25.945979 16931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:25.947794 16931 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:07:25.948586 16947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:25.948992 16931 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:25.949082 16931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "bd63449a17f7409b8c30bb83298a571a"
format_stamp: "Formatted at 2026-08-08 07:07:24 on dist-test-slave-77v9"
server_key: "a3a2bc39cbc960e9bf0eb3cbe1113ae6"
server_key_iv: "9427a3799c068e3772b58d3ef9038178"
server_key_version: "encryptionkey@0"
I20260808 07:07:25.949601 16931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:25.967875 16931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:25.970309 16931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:25.970679 16931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:25.970996 16931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:25.971345 16931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:25.971395 16931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:25.971421 16931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:25.971433 16931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:25.977749 16931 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:40391
I20260808 07:07:25.977842 17068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:40391 every 8 connection(s)
I20260808 07:07:25.978181 16931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:07:25.980688 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 16931
I20260808 07:07:25.980892 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 16260
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.60@KRBTEST.COM
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.61@KRBTEST.COM
Aug 08 07:07:25 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172845, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
I20260808 07:07:25.991555 16592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.978992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:58845 (local address 127.9.94.61:46021)
0808 07:07:25.979253 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.979255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.979403 (+ 148us) server_negotiation.cc:407] Connection header received
0808 07:07:25.980422 (+ 1019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.980424 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.980438 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.980497 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.982032 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.982998 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.984377 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.984660 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.984709 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.987869 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.987870 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.987871 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.987881 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.989805 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.990365 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.990366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.990367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.990428 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.990710 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.990711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.990711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.990867 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.990911 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.991304 (+ 393us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.991399 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236}
I20260808 07:07:25.992163 17073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.978960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:46021 (local address 127.9.94.2:58845)
0808 07:07:25.979336 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.979346 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.980298 (+ 952us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.980653 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.980654 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.981817 (+ 1163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.981912 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.981915 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.983108 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.983110 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.984252 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.984256 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.984801 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.984801 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.984922 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.985421 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.985433 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.987755 (+ 2322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.989918 (+ 2163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.989926 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.989928 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.990269 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.990498 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.990499 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.990499 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.990639 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.990962 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.990971 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.991147 (+ 176us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.991650 (+ 503us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.991855 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":3,"thread_start_us":98,"threads_started":1}
I20260808 07:07:25.992399 16929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.979284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:46477 (local address 127.9.94.60:45487)
0808 07:07:25.979340 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.979342 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.979355 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:07:25.980497 (+ 1142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.980498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.980513 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.980562 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.981517 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.982190 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.983572 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.983862 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.983899 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.988188 (+ 4289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.988189 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.988190 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.988197 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.991069 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.991485 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.991486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.991487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.991552 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.991782 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.991783 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.991783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.991912 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.991954 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.992157 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.992254 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:07:25.992796 17074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.978950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:45487 (local address 127.9.94.2:46477)
0808 07:07:25.979142 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.979188 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.980283 (+ 1095us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.980647 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.980652 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.981128 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.981414 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.981419 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.982322 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.982323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.983478 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.983480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.983980 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.983981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.984112 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.985662 (+ 1550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.985666 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.988089 (+ 2423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.991159 (+ 3070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.991160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.991160 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.991395 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.991627 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.991628 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.991629 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.991698 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.991998 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.991999 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.992040 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.992524 (+ 484us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.992633 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":107,"threads_started":1}
I20260808 07:07:25.993291 17069 heartbeater.cc:347] Connected to a master server at 127.9.94.60:45487
I20260808 07:07:25.993386 17069 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:25.993587 17069 heartbeater.cc:511] Master 127.9.94.60:45487 requested a full tablet report, sending...
I20260808 07:07:25.994006 16736 ts_manager.cc:194] Registered new tserver with Master: bd63449a17f7409b8c30bb83298a571a (127.9.94.2:40391)
I20260808 07:07:25.994171 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.979474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:42935 (local address 127.9.94.62:45719)
0808 07:07:25.979563 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:25.979566 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:25.979606 (+ 40us) server_negotiation.cc:407] Connection header received
0808 07:07:25.980477 (+ 871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:25.980478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:25.980494 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:25.980550 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:25.985605 (+ 5055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.986371 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.987683 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.987999 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.988065 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.990592 (+ 2527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:25.990593 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:25.990594 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:25.990603 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:25.992718 (+ 2115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.993188 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.993189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.993189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.993253 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:25.993457 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:25.993458 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:25.993458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:25.993620 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:25.993673 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:25.993923 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 07:07:25.994023 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 07:07:25.994503 17071 heartbeater.cc:347] Connected to a master server at 127.9.94.61:46021
I20260808 07:07:25.994570 17071 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:25.994645 17071 heartbeater.cc:511] Master 127.9.94.61:46021 requested a full tablet report, sending...
I20260808 07:07:25.994814 17075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:25.979264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.2:42935)
0808 07:07:25.979531 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:25.979543 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:25.980307 (+ 764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:25.980651 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:25.980652 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:25.985439 (+ 4787us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:25.985494 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.985495 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.986481 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.986482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.987584 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:25.987587 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:25.988121 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:25.988122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:25.988196 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:25.988764 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:25.988770 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:25.990481 (+ 1711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:25.992868 (+ 2387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.992869 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.992870 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.993095 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.993326 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:25.993327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:25.993327 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:25.993391 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:25.993732 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:25.993732 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:25.993776 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 07:07:25.994258 (+ 482us) client_negotiation.cc:240] Negotiation successful
0808 07:07:25.994381 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":88,"threads_started":1}
I20260808 07:07:25.994975 16541 ts_manager.cc:194] Registered new tserver with Master: bd63449a17f7409b8c30bb83298a571a (127.9.94.2:40391)
I20260808 07:07:25.995380 17070 heartbeater.cc:347] Connected to a master server at 127.9.94.62:45719
I20260808 07:07:25.995465 17070 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:25.995532 17070 heartbeater.cc:511] Master 127.9.94.62:45719 requested a full tablet report, sending...
I20260808 07:07:25.995713 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:40387
--local_ip_for_outbound_sockets=127.9.94.3
--tserver_master_addrs=127.9.94.62:45719
--webserver_port=43879
--webserver_interface=127.9.94.3
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.3.keytab
--principal=oryx/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.94.62:45719,127.9.94.61:46021
--tserver_master_addrs=127.9.94.62:45719,127.9.94.61:46021,127.9.94.60:45487 with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:07:25.995743 15909 ts_manager.cc:194] Re-registered known tserver with Master: bd63449a17f7409b8c30bb83298a571a (127.9.94.2:40391)
I20260808 07:07:25.996223 15909 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:42935
W20260808 07:07:26.089991 17076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:26.090278 17076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:26.090330 17076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:26.091917 17076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:26.092006 17076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:26.092058 17076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:26.094069 17076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.3.keytab
--principal=oryx/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:40387
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=43879
--tserver_master_addrs=127.9.94.62:45719,127.9.94.61:46021,127.9.94.60:45487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:26.094393 17076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:26.094712 17076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:07:26.095189 16499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.091398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:45487 (local address 127.0.0.1:59294)
0808 07:07:26.091483 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:26.091498 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:26.091555 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:26.091853 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:26.091855 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:26.091857 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:26.091916 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.091919 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.093074 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.093076 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.094069 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.094072 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.094970 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.094971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.095024 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.095029 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:07:26.095085 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 07:07:26.095127 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 07:07:26.095225 16929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.091522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59294 (local address 127.9.94.60:45487)
0808 07:07:26.091575 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.091577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.091590 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:07:26.091626 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.091627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.091656 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.091774 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:26.092013 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.092952 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.094208 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.094868 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.094964 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.095037 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.095095 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.095138 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:07:26.095598 16747 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 07:07:26.095841 16776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65c83b4dc8b749149b6ac835baeb7221. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } } }
I20260808 07:07:26.095988 16776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [sys.catalog]: This master's current role is: LEARNER
W20260808 07:07:26.101420 17082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:26.101567 17076 server_base.cc:1034] running on GCE node
W20260808 07:07:26.101364 17081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:26.101365 17085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:26.102108 17076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:26.102397 17076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:26.103574 17076 hybrid_clock.cc:648] HybridClock initialized: now 1786172846103563 us; error 36 us; skew 500 ppm
Aug 08 07:07:26 dist-test-slave-77v9 krb5kdc[15862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172846, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:26.106902 17076 init.cc:377] Logged in from keytab as oryx/127.9.94.3@KRBTEST.COM (short username oryx)
I20260808 07:07:26.107438 17076 webserver.cc:460] Webserver started at http://127.9.94.3:43879/ using document root <none> and password file <none>
I20260808 07:07:26.107704 17076 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:26.107808 17076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:26.109475 17076 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:07:26.110504 17093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:26.110765 17076 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:26.110882 17076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "917200053dbe44b5a2894f29554f333c"
format_stamp: "Formatted at 2026-08-08 07:07:24 on dist-test-slave-77v9"
server_key: "d3023c933a233928d12a6e2984c302ba"
server_key_iv: "c70216e2a6202fa686d427dce7fb298b"
server_key_version: "encryptionkey@0"
I20260808 07:07:26.111461 17076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:26.138676 17076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:26.141287 17076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:26.141490 17076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:26.141846 17076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:26.142261 17076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:26.142318 17076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:26.142349 17076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:26.142365 17076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:26.150025 17076 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:40387
I20260808 07:07:26.150187 17212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:40387 every 8 connection(s)
I20260808 07:07:26.150517 17076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:07:26.152743 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 17076
Aug 08 07:07:26 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172846, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.61@KRBTEST.COM
Aug 08 07:07:26 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172846, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.60@KRBTEST.COM
Aug 08 07:07:26 dist-test-slave-77v9 krb5kdc[15862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172846, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
I20260808 07:07:26.165683 16592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.152010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:39571 (local address 127.9.94.61:46021)
0808 07:07:26.152166 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.152170 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.152184 (+ 14us) server_negotiation.cc:407] Connection header received
0808 07:07:26.153117 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.153118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.153130 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.153176 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:26.154514 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.155336 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.156484 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.156839 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.157181 (+ 342us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.160891 (+ 3710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:26.160892 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:26.160892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:26.160900 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:26.162858 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.164440 (+ 1582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.164442 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.164442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.164508 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.164876 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.164876 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.164877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.165017 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:26.165065 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.165478 (+ 413us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.165566 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260808 07:07:26.166092 16929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.152559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:33499 (local address 127.9.94.60:45487)
0808 07:07:26.152612 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.152615 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.152624 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:26.153122 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.153124 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.153143 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.153177 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:26.154533 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.155136 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.156654 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.157190 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.157278 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.161656 (+ 4378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:26.161657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:26.161658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:26.161666 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:26.164745 (+ 3079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.165185 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.165186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.165187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.165244 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.165493 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.165494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.165495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.165641 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:26.165697 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.165909 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.165994 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:07:26.166360 17218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.151855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:46021 (local address 127.9.94.3:39571)
0808 07:07:26.151990 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:26.152002 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:26.152975 (+ 973us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:26.153381 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:26.153386 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:26.154068 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:26.154411 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.154417 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.155560 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.155561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.156393 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.156396 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.157256 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.157257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.157493 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.158147 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:26.158157 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:26.160743 (+ 2586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:26.163969 (+ 3226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:26.163978 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:26.163981 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:26.164339 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:26.164593 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:26.164594 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:26.164594 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:26.164756 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:26.165121 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:26.165127 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:26.165314 (+ 187us) client_negotiation.cc:769] Sending connection context
0808 07:07:26.165881 (+ 567us) client_negotiation.cc:240] Negotiation successful
0808 07:07:26.166082 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":4,"thread_start_us":76,"threads_started":1}
I20260808 07:07:26.166550 17219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.152377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:45487 (local address 127.9.94.3:33499)
0808 07:07:26.152524 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:26.152535 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:26.152982 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:26.153380 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:26.153385 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:26.154041 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:26.154410 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.154418 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.155290 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.155292 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.156564 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.156566 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.157344 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.157345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.157492 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.158211 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:26.158217 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:26.161559 (+ 3342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:26.164865 (+ 3306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:26.164866 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:26.164867 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:26.165095 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:26.165330 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:26.165331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:26.165331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:26.165409 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:26.165735 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:26.165736 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:26.165782 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 07:07:26.166226 (+ 444us) client_negotiation.cc:240] Negotiation successful
0808 07:07:26.166343 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":27,"thread_start_us":77,"threads_started":1}
I20260808 07:07:26.167055 17213 heartbeater.cc:347] Connected to a master server at 127.9.94.60:45487
I20260808 07:07:26.167156 17213 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:26.167289 17215 heartbeater.cc:347] Connected to a master server at 127.9.94.61:46021
I20260808 07:07:26.167336 17215 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:26.167392 17213 heartbeater.cc:511] Master 127.9.94.60:45487 requested a full tablet report, sending...
I20260808 07:07:26.167416 17215 heartbeater.cc:511] Master 127.9.94.61:46021 requested a full tablet report, sending...
I20260808 07:07:26.167867 16541 ts_manager.cc:194] Registered new tserver with Master: 917200053dbe44b5a2894f29554f333c (127.9.94.3:40387)
I20260808 07:07:26.167881 16736 ts_manager.cc:194] Registered new tserver with Master: 917200053dbe44b5a2894f29554f333c (127.9.94.3:40387)
I20260808 07:07:26.168046 17217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.151575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.3:58335)
0808 07:07:26.151791 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:26.151832 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:26.152974 (+ 1142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:26.153380 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:26.153385 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:26.157078 (+ 3693us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:26.157158 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.157160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.158114 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.158115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.158951 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.158954 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.159495 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.159496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.159567 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.160004 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:26.160010 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:26.164024 (+ 4014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:26.166510 (+ 2486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:26.166511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:26.166512 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:26.166897 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:26.167136 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:26.167137 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:26.167138 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:26.167203 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:26.167499 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:26.167500 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:26.167539 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 07:07:26.167597 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:07:26.167705 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":94,"threads_started":1}
I20260808 07:07:26.168383 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.151564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:58335 (local address 127.9.94.62:45719)
0808 07:07:26.151642 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.151644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.152016 (+ 372us) server_negotiation.cc:407] Connection header received
0808 07:07:26.153123 (+ 1107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.153124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.153139 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.153177 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:26.157269 (+ 4092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.158010 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.159058 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.159367 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.159440 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.164125 (+ 4685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:26.164127 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:26.164127 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:26.164134 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:26.166399 (+ 2265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.166997 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.166999 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.166999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.167067 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.167261 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.167262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.167262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.167403 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:26.167470 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.168175 (+ 705us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.168267 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 07:07:26.168709 17214 heartbeater.cc:347] Connected to a master server at 127.9.94.62:45719
I20260808 07:07:26.168766 17214 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:26.168825 17214 heartbeater.cc:511] Master 127.9.94.62:45719 requested a full tablet report, sending...
I20260808 07:07:26.169103 15909 ts_manager.cc:194] Re-registered known tserver with Master: 917200053dbe44b5a2894f29554f333c (127.9.94.3:40387)
I20260808 07:07:26.169593 15909 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:58335
I20260808 07:07:26.170857 17225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.153987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54030 (local address 127.9.94.62:45719)
0808 07:07:26.159118 (+ 5131us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.159120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.159255 (+ 135us) server_negotiation.cc:407] Connection header received
0808 07:07:26.159291 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.159292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.159311 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.159485 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:26.160305 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.161205 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.162698 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.163105 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.163149 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.165335 (+ 2186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:26.165336 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:26.165336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:26.165342 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:26.168414 (+ 3072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.169197 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.169198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.169199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.169259 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.169468 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.169469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.169470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.169583 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:26.170478 (+ 895us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.170649 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.170747 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5099,"thread_start_us":112,"threads_started":1}
I20260808 07:07:26.171072 17229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.155412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53702 (local address 127.9.94.61:46021)
0808 07:07:26.155535 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.155537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.159417 (+ 3880us) server_negotiation.cc:407] Connection header received
0808 07:07:26.159444 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.159445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.159459 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.159518 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:26.160229 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.161001 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.161975 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.162251 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.162318 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.163824 (+ 1506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:26.163825 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:26.163825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:26.163832 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:26.169528 (+ 5696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.169964 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.169965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.169966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.170033 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.170221 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.170222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.170222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.170351 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:26.170449 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.170877 (+ 428us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.170972 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":82,"threads_started":1}
I20260808 07:07:26.171481 17224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.153960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59306 (local address 127.9.94.60:45487)
0808 07:07:26.154233 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.154235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.154424 (+ 189us) server_negotiation.cc:407] Connection header received
0808 07:07:26.154449 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.154450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.154462 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.154520 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:26.155314 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.156094 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.157358 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.157639 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.163905 (+ 6266us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.164289 (+ 384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:26.164290 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:26.164291 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:26.164298 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:26.169965 (+ 5667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.170293 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.170294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.170295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.170348 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.170569 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.170570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.170570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.170713 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:26.171229 (+ 516us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.171281 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.171368 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":56,"threads_started":1}
I20260808 07:07:26.172762 15909 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54030:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:07:26.174548 15909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:26.175362 16708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: NON_VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: true } } }
I20260808 07:07:26.175473 16708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:26.177346 17233 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221: attempting to promote NON_VOTER 7b531398de4348b1901b6b063033f0cd to VOTER
I20260808 07:07:26.177515 17233 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } }
I20260808 07:07:26.178085 16551 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 1 FOLLOWER]: Refusing update from remote peer 65c83b4dc8b749149b6ac835baeb7221: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 07:07:26.178131 16747 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 1 LEARNER]: Refusing update from remote peer 65c83b4dc8b749149b6ac835baeb7221: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 07:07:26.178318 17231 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 07:07:26.178413 17232 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 07:07:26.179059 17232 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 7b531398de4348b1901b6b063033f0cd (127.9.94.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } } }
I20260808 07:07:26.180032 17232 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } } }
I20260808 07:07:26.180145 17232 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:26.180413 17232 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } } }
I20260808 07:07:26.180509 17232 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:26.180570 16708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } } }
I20260808 07:07:26.180665 16708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:26.180639 16551 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 7b531398de4348b1901b6b063033f0cd (127.9.94.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } } }
I20260808 07:07:26.181057 16747 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 7b531398de4348b1901b6b063033f0cd (127.9.94.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } } }
I20260808 07:07:26.182144 16776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } } }
I20260808 07:07:26.182250 16776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:07:26.182463 17241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "65c83b4dc8b749149b6ac835baeb7221" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } } }
I20260808 07:07:26.182586 17241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:07:26.187702 17246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.183291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:40387 (local address 127.0.0.1:37514)
0808 07:07:26.184172 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:26.184183 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:26.184252 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:26.184461 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:26.184462 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:26.184464 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:26.184504 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.184505 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.185544 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.185545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.186450 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.186453 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.187396 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.187397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.187465 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.187470 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:07:26.187535 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 07:07:26.187584 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":855,"mutex_wait_us":245,"thread_start_us":84,"threads_started":1}
I20260808 07:07:26.187774 17244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.183422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33700 (local address 127.9.94.1:38695)
0808 07:07:26.183723 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.183727 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.183738 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:26.183781 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.183783 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.183799 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.183903 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:26.184024 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.185181 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.186731 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.187409 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.187506 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.187578 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.187657 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.187692 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":87,"threads_started":1}
I20260808 07:07:26.187810 16499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.183290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:38695 (local address 127.0.0.1:33700)
0808 07:07:26.183417 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:26.183433 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:26.183484 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:26.183915 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:26.183916 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:26.183918 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:26.183969 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.183971 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.185280 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.185281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.186632 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.186635 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.187512 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.187513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.187580 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.187583 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:26.187642 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 07:07:26.187679 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"mutex_wait_us":56}
I20260808 07:07:26.188076 17242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.183372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37514 (local address 127.9.94.3:40387)
0808 07:07:26.183638 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.183644 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.184250 (+ 606us) server_negotiation.cc:407] Connection header received
0808 07:07:26.184327 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.184330 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.184359 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.184465 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:26.184589 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.185455 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.186544 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.187301 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.187382 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.187468 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.187927 (+ 459us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.187991 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":106,"threads_started":1}
I20260808 07:07:26.188416 17243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.183392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:40391 (local address 127.0.0.1:34880)
0808 07:07:26.183645 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:26.183655 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:26.183711 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:26.184079 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:26.184080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:26.184082 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:26.184136 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.184138 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.185411 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.185412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.186869 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.186870 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.188018 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.188019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.188090 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.188095 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:07:26.188280 (+ 185us) client_negotiation.cc:240] Negotiation successful
0808 07:07:26.188329 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":88,"thread_start_us":102,"threads_started":1}
I20260808 07:07:26.188670 17247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.183657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34880 (local address 127.9.94.2:40391)
0808 07:07:26.183836 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.183841 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.183854 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:07:26.183896 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.183898 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.183918 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.184005 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:26.184229 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.185326 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.186958 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.187596 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.187674 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.187768 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.188549 (+ 781us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.188600 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":89,"threads_started":1}
I20260808 07:07:26.188575 16854 tablet_service.cc:1467] Processing CreateTablet for tablet f3baf0f13e0e46f0b5727946fdb178a9 (DEFAULT_TABLE table=test-table [id=df0a0eb1cc3d4445a63cd251e113e2bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:26.188699 17145 tablet_service.cc:1467] Processing CreateTablet for tablet f3baf0f13e0e46f0b5727946fdb178a9 (DEFAULT_TABLE table=test-table [id=df0a0eb1cc3d4445a63cd251e113e2bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:26.189026 16854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3baf0f13e0e46f0b5727946fdb178a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:26.189095 17145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3baf0f13e0e46f0b5727946fdb178a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:26.192857 17249 tablet_bootstrap.cc:492] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c: Bootstrap starting.
I20260808 07:07:26.193526 17001 tablet_service.cc:1467] Processing CreateTablet for tablet f3baf0f13e0e46f0b5727946fdb178a9 (DEFAULT_TABLE table=test-table [id=df0a0eb1cc3d4445a63cd251e113e2bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:26.193707 17249 tablet_bootstrap.cc:654] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:26.193847 17001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3baf0f13e0e46f0b5727946fdb178a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:26.194075 17249 log.cc:824] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:26.194460 17248 tablet_bootstrap.cc:492] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe: Bootstrap starting.
I20260808 07:07:26.195071 17249 tablet_bootstrap.cc:492] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c: No bootstrap required, opened a new log
I20260808 07:07:26.195212 17248 tablet_bootstrap.cc:654] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:26.195242 17249 ts_tablet_manager.cc:1397] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:07:26.195569 17248 log.cc:824] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:26.196558 17248 tablet_bootstrap.cc:492] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe: No bootstrap required, opened a new log
I20260808 07:07:26.196650 17248 ts_tablet_manager.cc:1397] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:07:26.197434 17252 tablet_bootstrap.cc:492] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a: Bootstrap starting.
I20260808 07:07:26.197562 17249 raft_consensus.cc:348] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:26.197753 17249 raft_consensus.cc:374] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:26.197798 17249 raft_consensus.cc:729] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 917200053dbe44b5a2894f29554f333c, State: Initialized, Role: FOLLOWER
I20260808 07:07:26.197938 17249 consensus_queue.cc:260] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:26.198237 17249 ts_tablet_manager.cc:1428] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 07:07:26.198390 17214 heartbeater.cc:503] Master 127.9.94.62:45719 was elected leader, sending a full tablet report...
I20260808 07:07:26.198734 17252 tablet_bootstrap.cc:654] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:26.199213 17252 log.cc:824] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:26.200073 17252 tablet_bootstrap.cc:492] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a: No bootstrap required, opened a new log
I20260808 07:07:26.200129 17252 ts_tablet_manager.cc:1397] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:07:26.200337 17248 raft_consensus.cc:348] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:26.200508 17248 raft_consensus.cc:374] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:26.200559 17248 raft_consensus.cc:729] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a21e18e8d94b480c885a3aabd893cfbe, State: Initialized, Role: FOLLOWER
I20260808 07:07:26.200696 17248 consensus_queue.cc:260] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:26.201030 17248 ts_tablet_manager.cc:1428] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260808 07:07:26.201210 16924 heartbeater.cc:503] Master 127.9.94.62:45719 was elected leader, sending a full tablet report...
I20260808 07:07:26.202927 17252 raft_consensus.cc:348] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:26.203048 17252 raft_consensus.cc:374] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:26.203069 17252 raft_consensus.cc:729] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd63449a17f7409b8c30bb83298a571a, State: Initialized, Role: FOLLOWER
I20260808 07:07:26.203179 17252 consensus_queue.cc:260] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:26.203406 17252 ts_tablet_manager.cc:1428] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:07:26.203483 17070 heartbeater.cc:503] Master 127.9.94.62:45719 was elected leader, sending a full tablet report...
W20260808 07:07:26.229085 17072 tablet.cc:2369] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:07:26.232090 17253 raft_consensus.cc:482] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:26.232209 17253 raft_consensus.cc:504] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:26.232519 17253 leader_election.cc:288] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a21e18e8d94b480c885a3aabd893cfbe (127.9.94.1:38695), bd63449a17f7409b8c30bb83298a571a (127.9.94.2:40391)
I20260808 07:07:26.237250 17244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.232960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:46769 (local address 127.9.94.1:38695)
0808 07:07:26.233017 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.233019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.233030 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:26.233065 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.233066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.233078 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.233142 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:26.233439 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.234279 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.236065 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.236751 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.236893 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.236907 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.237123 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.237169 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:07:26.237250 17247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.232978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:51759 (local address 127.9.94.2:40391)
0808 07:07:26.233043 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.233046 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.233055 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:26.233083 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.233084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.233098 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.233160 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:26.233439 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.234320 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.236035 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.236776 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.236893 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.236907 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.237109 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.237161 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:07:26.237236 17217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.232896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:40391 (local address 127.9.94.3:51759)
0808 07:07:26.232952 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:26.232963 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:26.233009 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:26.233181 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:26.233182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:26.233183 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:26.233300 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.233302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.234414 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.234415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.235921 (+ 1506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.235922 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.236894 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.236895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.236984 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.236988 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:26.237061 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 07:07:26.237106 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":137}
I20260808 07:07:26.237226 17218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.232732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:38695 (local address 127.9.94.3:46769)
0808 07:07:26.232834 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:26.232850 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:26.232915 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:26.233181 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:26.233182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:26.233183 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:26.233300 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.233302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.234414 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.234415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.235873 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:26.235878 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.236894 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.236895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:26.236984 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.236988 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:26.237077 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 07:07:26.237108 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":71}
I20260808 07:07:26.237736 17022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3baf0f13e0e46f0b5727946fdb178a9" candidate_uuid: "917200053dbe44b5a2894f29554f333c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd63449a17f7409b8c30bb83298a571a" is_pre_election: true
I20260808 07:07:26.237762 16875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3baf0f13e0e46f0b5727946fdb178a9" candidate_uuid: "917200053dbe44b5a2894f29554f333c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21e18e8d94b480c885a3aabd893cfbe" is_pre_election: true
I20260808 07:07:26.237911 16875 raft_consensus.cc:2454] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 917200053dbe44b5a2894f29554f333c in term 0.
I20260808 07:07:26.237911 17022 raft_consensus.cc:2454] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 917200053dbe44b5a2894f29554f333c in term 0.
I20260808 07:07:26.238436 17098 leader_election.cc:302] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 917200053dbe44b5a2894f29554f333c, a21e18e8d94b480c885a3aabd893cfbe; no voters:
I20260808 07:07:26.238590 17253 raft_consensus.cc:2781] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:26.238656 17253 raft_consensus.cc:482] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:26.238685 17253 raft_consensus.cc:3037] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:26.239471 17253 raft_consensus.cc:504] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:26.239627 17253 leader_election.cc:288] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [CANDIDATE]: Term 1 election: Requested vote from peers a21e18e8d94b480c885a3aabd893cfbe (127.9.94.1:38695), bd63449a17f7409b8c30bb83298a571a (127.9.94.2:40391)
I20260808 07:07:26.239853 16875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3baf0f13e0e46f0b5727946fdb178a9" candidate_uuid: "917200053dbe44b5a2894f29554f333c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21e18e8d94b480c885a3aabd893cfbe"
I20260808 07:07:26.239868 17022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3baf0f13e0e46f0b5727946fdb178a9" candidate_uuid: "917200053dbe44b5a2894f29554f333c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd63449a17f7409b8c30bb83298a571a"
I20260808 07:07:26.239943 16875 raft_consensus.cc:3037] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:26.239959 17022 raft_consensus.cc:3037] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:26.240703 16875 raft_consensus.cc:2454] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917200053dbe44b5a2894f29554f333c in term 1.
I20260808 07:07:26.240890 17022 raft_consensus.cc:2454] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 917200053dbe44b5a2894f29554f333c in term 1.
I20260808 07:07:26.240908 17098 leader_election.cc:302] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 917200053dbe44b5a2894f29554f333c, a21e18e8d94b480c885a3aabd893cfbe; no voters:
I20260808 07:07:26.241029 17253 raft_consensus.cc:2781] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:26.241211 17253 raft_consensus.cc:686] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [term 1 LEADER]: Becoming Leader. State: Replica: 917200053dbe44b5a2894f29554f333c, State: Running, Role: LEADER
I20260808 07:07:26.241326 17253 consensus_queue.cc:237] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:26.242247 15910 catalog_manager.cc:5495] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c reported cstate change: term changed from 0 to 1, leader changed from <none> to 917200053dbe44b5a2894f29554f333c (127.9.94.3). New cstate: current_term: 1 leader_uuid: "917200053dbe44b5a2894f29554f333c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } health_report { overall_health: UNKNOWN } } }
I20260808 07:07:26.263957 17242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.261385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37524 (local address 127.9.94.3:40387)
0808 07:07:26.261456 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.261458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.261469 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:26.261505 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.261506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.261528 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.261593 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:26.261745 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.262228 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.263122 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.263309 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.263365 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.263530 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:26.263640 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:26.263714 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.263786 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.263805 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 07:07:26.266364 16875 raft_consensus.cc:1261] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe [term 1 FOLLOWER]: Refusing update from remote peer 917200053dbe44b5a2894f29554f333c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:26.266363 17022 raft_consensus.cc:1261] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a [term 1 FOLLOWER]: Refusing update from remote peer 917200053dbe44b5a2894f29554f333c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:26.266774 17253 consensus_queue.cc:1035] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:26.266945 17257 consensus_queue.cc:1035] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:26.269426 17260 mvcc.cc:205] Tried to move back new op lower bound from 7316163978303619072 to 7316163978205306880. Current Snapshot: MvccSnapshot[applied={T|T < 7316163978303619072}]
I20260808 07:07:26.271168 17261 mvcc.cc:205] Tried to move back new op lower bound from 7316163978303619072 to 7316163978205306880. Current Snapshot: MvccSnapshot[applied={T|T < 7316163978303619072}]
I20260808 07:07:26.273262 15910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:26.273353 15910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:26.275406 15910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 65c83b4dc8b749149b6ac835baeb7221: Sending DeleteTablet for 3 replicas of tablet f3baf0f13e0e46f0b5727946fdb178a9
I20260808 07:07:26.275717 17145 tablet_service.cc:1514] Processing DeleteTablet for tablet f3baf0f13e0e46f0b5727946fdb178a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:26 UTC) from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:37514
I20260808 07:07:26.275791 16854 tablet_service.cc:1514] Processing DeleteTablet for tablet f3baf0f13e0e46f0b5727946fdb178a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:26 UTC) from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:33700
I20260808 07:07:26.275832 17001 tablet_service.cc:1514] Processing DeleteTablet for tablet f3baf0f13e0e46f0b5727946fdb178a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:26 UTC) from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:34880
I20260808 07:07:26.276069 17272 tablet_replica.cc:330] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a: stopping tablet replica
I20260808 07:07:26.276254 17271 tablet_replica.cc:330] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe: stopping tablet replica
I20260808 07:07:26.276367 17271 raft_consensus.cc:2229] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:26.276489 17271 raft_consensus.cc:2258] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:26.277032 17271 ts_tablet_manager.cc:1905] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:26.277297 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 15875
I20260808 07:07:26.276247 17272 raft_consensus.cc:2229] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:26.279374 17272 raft_consensus.cc:2258] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:26.279743 17270 tablet_replica.cc:330] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c: stopping tablet replica
I20260808 07:07:26.279865 17270 raft_consensus.cc:2229] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:07:26.279985 17270 raft_consensus.cc:2258] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:26.280207 17272 ts_tablet_manager.cc:1905] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:26.280514 17270 ts_tablet_manager.cc:1905] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:26.282250 17272 ts_tablet_manager.cc:1918] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:26.282403 17272 log.cc:1196] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/f3baf0f13e0e46f0b5727946fdb178a9
I20260808 07:07:26.282425 17270 ts_tablet_manager.cc:1918] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:26.282495 17270 log.cc:1196] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/f3baf0f13e0e46f0b5727946fdb178a9
I20260808 07:07:26.282820 17270 ts_tablet_manager.cc:1939] T f3baf0f13e0e46f0b5727946fdb178a9 P 917200053dbe44b5a2894f29554f333c: Deleting consensus metadata
I20260808 07:07:26.282970 17272 ts_tablet_manager.cc:1939] T f3baf0f13e0e46f0b5727946fdb178a9 P bd63449a17f7409b8c30bb83298a571a: Deleting consensus metadata
I20260808 07:07:26.283294 17271 ts_tablet_manager.cc:1918] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:26.283381 17271 log.cc:1196] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-0/wal/wals/f3baf0f13e0e46f0b5727946fdb178a9
I20260808 07:07:26.283665 17271 ts_tablet_manager.cc:1939] T f3baf0f13e0e46f0b5727946fdb178a9 P a21e18e8d94b480c885a3aabd893cfbe: Deleting consensus metadata
W20260808 07:07:26.286489 16948 connection.cc:535] server connection from 127.0.0.1:34880 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 07:07:26.286723 17098 connection.cc:535] server connection from 127.0.0.1:37514 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 07:07:26.286742 16807 connection.cc:535] server connection from 127.0.0.1:33700 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 07:07:26.293406 17224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.276905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59316 (local address 127.9.94.60:45487)
0808 07:07:26.277109 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.277112 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.285064 (+ 7952us) server_negotiation.cc:407] Connection header received
0808 07:07:26.285147 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.285148 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.285164 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.285240 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:26.285845 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.286353 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.287564 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.287782 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.287859 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.290047 (+ 2188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:26.290048 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:26.290049 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:26.290055 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:26.291765 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.292137 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.292138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.292138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.292193 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.292441 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.292441 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.292442 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.292583 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:26.292683 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.293167 (+ 484us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.293261 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176}
I20260808 07:07:26.297186 16929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.289190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59318 (local address 127.9.94.60:45487)
0808 07:07:26.289233 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.289235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.289461 (+ 226us) server_negotiation.cc:407] Connection header received
0808 07:07:26.289557 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.289558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.289568 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.289617 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:26.290358 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.291098 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.292212 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.292525 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.292565 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.294280 (+ 1715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:26.294281 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:26.294282 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:26.294288 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:26.295929 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.296314 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.296315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.296316 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.296371 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.296582 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.296583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.296583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.296709 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:26.296853 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.297005 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.297088 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:07:26.297266 17229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:26.288963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53714 (local address 127.9.94.61:46021)
0808 07:07:26.289016 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:26.289018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:26.289112 (+ 94us) server_negotiation.cc:407] Connection header received
0808 07:07:26.289209 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:26.289210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:26.289227 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:26.289259 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:26.289990 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.290743 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.291862 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:26.292209 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:26.292250 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:26.294101 (+ 1851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:26.294102 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:26.294103 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:26.294110 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:26.295824 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.296351 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.296352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.296352 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.296414 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:26.296643 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:26.296644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:26.296644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:26.296771 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:26.296874 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:26.297090 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 07:07:26.297178 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:07:27.271467 17283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.271134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.1:33671)
0808 07:07:27.271279 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.271395 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
W20260808 07:07:27.271930 16924 heartbeater.cc:644] Failed to heartbeat to 127.9.94.62:45719 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
I20260808 07:07:27.272069 17284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.271817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.3:51991)
0808 07:07:27.271942 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.272020 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260808 07:07:27.272239 17285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.272035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.2:46933)
0808 07:07:27.272127 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.272197 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71,"thread_start_us":47,"threads_started":1}
W20260808 07:07:27.272436 17214 heartbeater.cc:644] Failed to heartbeat to 127.9.94.62:45719 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
W20260808 07:07:27.272497 17070 heartbeater.cc:644] Failed to heartbeat to 127.9.94.62:45719 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
I20260808 07:07:27.775348 17286 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c83b4dc8b749149b6ac835baeb7221)
I20260808 07:07:27.775487 17286 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } }
I20260808 07:07:27.775838 17286 leader_election.cc:288] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c83b4dc8b749149b6ac835baeb7221 (127.9.94.62:45719), 6e83aed0f86b49f694c3d39e07a31c0d (127.9.94.61:46021)
I20260808 07:07:27.776187 17287 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c83b4dc8b749149b6ac835baeb7221)
I20260808 07:07:27.776361 17287 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } }
I20260808 07:07:27.776527 17288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.776097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.0.0.1:54460)
0808 07:07:27.776401 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.776471 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":83,"threads_started":1}
W20260808 07:07:27.776710 16722 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
I20260808 07:07:27.777041 17287 leader_election.cc:288] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c83b4dc8b749149b6ac835baeb7221 (127.9.94.62:45719), 7b531398de4348b1901b6b063033f0cd (127.9.94.60:45487)
I20260808 07:07:27.777175 17288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.777080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.0.0.1:54476)
0808 07:07:27.777123 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.777150 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 07:07:27.777249 16722 leader_election.cc:334] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65c83b4dc8b749149b6ac835baeb7221 (127.9.94.62:45719): Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
I20260808 07:07:27.777429 17292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.776889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.0.0.1:54462)
0808 07:07:27.777347 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.777393 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":51,"threads_started":1}
W20260808 07:07:27.777592 16525 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
I20260808 07:07:27.778151 17293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.778034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.0.0.1:54488)
0808 07:07:27.778082 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.778119 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 07:07:27.778245 16525 leader_election.cc:334] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65c83b4dc8b749149b6ac835baeb7221 (127.9.94.62:45719): Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
I20260808 07:07:27.780049 17289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.776332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:46021 (local address 127.0.0.1:53724)
0808 07:07:27.776494 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.776507 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:27.776587 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:27.776873 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:27.776874 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:27.776877 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:27.776945 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:27.776948 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.778071 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.778072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:27.779111 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:27.779114 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.779770 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.779771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:27.779845 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:27.779850 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:07:27.779930 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 07:07:27.779979 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":50,"threads_started":1}
I20260808 07:07:27.780057 17290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.776485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53724 (local address 127.9.94.61:46021)
0808 07:07:27.776597 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:27.776599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:27.776613 (+ 14us) server_negotiation.cc:407] Connection header received
0808 07:07:27.776648 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:27.776649 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:27.776661 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:27.776795 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:27.777058 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.778007 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.779223 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.779666 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.779744 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:27.779755 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:27.779936 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 07:07:27.779982 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":58,"threads_started":1}
I20260808 07:07:27.780290 16551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b531398de4348b1901b6b063033f0cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" is_pre_election: true
I20260808 07:07:27.780407 16551 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b531398de4348b1901b6b063033f0cd in term 1.
I20260808 07:07:27.780601 16722 leader_election.cc:302] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e83aed0f86b49f694c3d39e07a31c0d, 7b531398de4348b1901b6b063033f0cd; no voters: 65c83b4dc8b749149b6ac835baeb7221
I20260808 07:07:27.780751 17286 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 07:07:27.780800 17292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.777149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:45487 (local address 127.0.0.1:59324)
0808 07:07:27.777498 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.777508 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:27.777564 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:27.777878 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:27.777879 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:27.777883 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:27.777928 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:27.777929 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.778802 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.778803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:27.779739 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:27.779743 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.780517 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.780519 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:27.780583 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:27.780586 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:27.780674 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 07:07:27.780716 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":71,"threads_started":1}
I20260808 07:07:27.780848 17286 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c83b4dc8b749149b6ac835baeb7221)
I20260808 07:07:27.780855 17294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.777479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59324 (local address 127.9.94.60:45487)
0808 07:07:27.777683 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:27.777685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:27.777695 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:07:27.777733 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:27.777734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:27.777748 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:27.777838 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:27.778026 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.778705 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.779824 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.780358 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.780479 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:27.780492 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:27.780683 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 07:07:27.780728 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":100,"threads_started":1}
I20260808 07:07:27.780900 17286 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:07:27.781122 16747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7b531398de4348b1901b6b063033f0cd" is_pre_election: true
I20260808 07:07:27.781790 17286 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } }
I20260808 07:07:27.781958 17286 leader_election.cc:288] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [CANDIDATE]: Term 2 election: Requested vote from peers 65c83b4dc8b749149b6ac835baeb7221 (127.9.94.62:45719), 6e83aed0f86b49f694c3d39e07a31c0d (127.9.94.61:46021)
I20260808 07:07:27.782006 16747 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e83aed0f86b49f694c3d39e07a31c0d in current term 2: Already voted for candidate 7b531398de4348b1901b6b063033f0cd in this term.
I20260808 07:07:27.782143 17289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.782055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.0.0.1:54498)
0808 07:07:27.782090 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.782119 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260808 07:07:27.782215 16551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b531398de4348b1901b6b063033f0cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6e83aed0f86b49f694c3d39e07a31c0d"
I20260808 07:07:27.782249 16526 leader_election.cc:302] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e83aed0f86b49f694c3d39e07a31c0d; no voters: 65c83b4dc8b749149b6ac835baeb7221, 7b531398de4348b1901b6b063033f0cd
I20260808 07:07:27.782306 16551 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:07:27.782497 17289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.782387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.0.0.1:54514)
0808 07:07:27.782453 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.782476 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 07:07:27.782585 16722 leader_election.cc:334] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 65c83b4dc8b749149b6ac835baeb7221 (127.9.94.62:45719): Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
I20260808 07:07:27.783106 16551 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b531398de4348b1901b6b063033f0cd in term 2.
I20260808 07:07:27.783277 17287 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:07:27.783389 16722 leader_election.cc:302] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e83aed0f86b49f694c3d39e07a31c0d, 7b531398de4348b1901b6b063033f0cd; no voters: 65c83b4dc8b749149b6ac835baeb7221
I20260808 07:07:27.783488 17286 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:07:27.783641 17286 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [term 2 LEADER]: Becoming Leader. State: Replica: 7b531398de4348b1901b6b063033f0cd, State: Running, Role: LEADER
I20260808 07:07:27.783728 17286 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } }
I20260808 07:07:27.784096 17296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b531398de4348b1901b6b063033f0cd. Latest consensus state: current_term: 2 leader_uuid: "7b531398de4348b1901b6b063033f0cd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } } }
I20260808 07:07:27.784215 17296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:27.784405 17298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:27.784917 17298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:27.784986 17298 catalog_manager.cc:1259] Loaded cluster ID: c70e4f5dc2f34b0796410f72a3f1a7d0
I20260808 07:07:27.785037 17298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:27.785214 17298 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:27.785305 17298 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: Loaded TSK: 0
I20260808 07:07:27.785450 17298 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:07:27.795696 16736 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59318:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:07:27.797747 16736 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:27.799088 17289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.798870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.0.0.1:54536)
0808 07:07:27.798996 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.799048 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260808 07:07:27.799235 16551 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [term 2 FOLLOWER]: Refusing update from remote peer 7b531398de4348b1901b6b063033f0cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 07:07:27.799439 17289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.799356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.0.0.1:54548)
0808 07:07:27.799388 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.799415 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260808 07:07:27.799587 16722 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd -> Peer 65c83b4dc8b749149b6ac835baeb7221 (127.9.94.62:45719): Couldn't send request to peer 65c83b4dc8b749149b6ac835baeb7221. Status: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 07:07:27.799589 17286 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 07:07:27.800349 17287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b531398de4348b1901b6b063033f0cd. Latest consensus state: current_term: 2 leader_uuid: "7b531398de4348b1901b6b063033f0cd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } } }
I20260808 07:07:27.800448 17287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:07:27.801153 17296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "7b531398de4348b1901b6b063033f0cd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } } }
I20260808 07:07:27.801262 17296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:27.801352 17287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "7b531398de4348b1901b6b063033f0cd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "65c83b4dc8b749149b6ac835baeb7221" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45719 } } peers { permanent_uuid: "6e83aed0f86b49f694c3d39e07a31c0d" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "7b531398de4348b1901b6b063033f0cd" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 45487 } attrs { promote: false } } }
I20260808 07:07:27.801434 17287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e83aed0f86b49f694c3d39e07a31c0d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:07:27.801625 17300 mvcc.cc:205] Tried to move back new op lower bound from 7316163984582410240 to 7316163984522854400. Current Snapshot: MvccSnapshot[applied={T|T < 7316163984582410240 or (T in {7316163984582410240})}]
I20260808 07:07:27.807093 17288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.803684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:40387 (local address 127.0.0.1:37538)
0808 07:07:27.804159 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.804169 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:27.804241 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:27.804389 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:27.804390 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:27.804393 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:27.804454 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:27.804455 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.805231 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.805232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:27.806088 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:27.806091 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.806857 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.806858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:27.806918 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:27.806922 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:27.806975 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 07:07:27.807016 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459}
I20260808 07:07:27.807116 17305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.803781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37538 (local address 127.9.94.3:40387)
0808 07:07:27.803977 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:27.803980 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:27.804228 (+ 248us) server_negotiation.cc:407] Connection header received
0808 07:07:27.804300 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:27.804302 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:27.804314 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:27.804387 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:27.804542 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.805146 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.806186 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.806773 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.806851 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:27.806868 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:27.806995 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 07:07:27.807041 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":130,"threads_started":1}
I20260808 07:07:27.807363 17145 tablet_service.cc:1467] Processing CreateTablet for tablet e4537510658749518741f596a47032b8 (DEFAULT_TABLE table=test-table [id=723b24eae57a4c5a82f6deea7e5f2a57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:27.807534 17145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4537510658749518741f596a47032b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:27.807813 17306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.803877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33702 (local address 127.9.94.1:38695)
0808 07:07:27.804051 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:27.804053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:27.804475 (+ 422us) server_negotiation.cc:407] Connection header received
0808 07:07:27.804587 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:27.804588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:27.804599 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:27.804662 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:27.804854 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.805567 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.806745 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.807317 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.807396 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:27.807411 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:27.807588 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 07:07:27.807639 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":60,"threads_started":1}
I20260808 07:07:27.807909 17289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.803920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:40391 (local address 127.0.0.1:34892)
0808 07:07:27.804331 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.804339 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:27.804376 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:27.804505 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:27.804505 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:27.804507 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:27.804535 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:27.804536 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.805637 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.805638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:27.806773 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:27.806776 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.807586 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.807587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:27.807638 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:27.807641 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:27.807670 (+ 29us) client_negotiation.cc:240] Negotiation successful
0808 07:07:27.807817 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":55,"thread_start_us":193,"threads_started":1}
I20260808 07:07:27.808137 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.803807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:38695 (local address 127.0.0.1:33702)
0808 07:07:27.804252 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.804263 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:27.804503 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:27.804665 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:27.804666 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:27.804667 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:27.804736 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:27.804738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.805655 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.805656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:27.806631 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:27.806633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.807413 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.807414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:27.807487 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:27.807492 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:07:27.807957 (+ 465us) client_negotiation.cc:240] Negotiation successful
0808 07:07:27.808069 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"mutex_wait_us":46}
I20260808 07:07:27.808211 17308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.804151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34892 (local address 127.9.94.2:40391)
0808 07:07:27.804264 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:27.804266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:27.804370 (+ 104us) server_negotiation.cc:407] Connection header received
0808 07:07:27.804428 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:27.804428 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:27.804443 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:27.804507 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:27.804710 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.805526 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.806879 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:27.807486 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:27.808037 (+ 551us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:27.808055 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:27.808078 (+ 23us) server_negotiation.cc:299] Negotiation successful
0808 07:07:27.808124 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":61,"threads_started":1}
I20260808 07:07:27.808383 16854 tablet_service.cc:1467] Processing CreateTablet for tablet e4537510658749518741f596a47032b8 (DEFAULT_TABLE table=test-table [id=723b24eae57a4c5a82f6deea7e5f2a57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:27.808542 16854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4537510658749518741f596a47032b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:27.808604 17001 tablet_service.cc:1467] Processing CreateTablet for tablet e4537510658749518741f596a47032b8 (DEFAULT_TABLE table=test-table [id=723b24eae57a4c5a82f6deea7e5f2a57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:27.808717 17001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4537510658749518741f596a47032b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:27.809753 17309 tablet_bootstrap.cc:492] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c: Bootstrap starting.
I20260808 07:07:27.810111 17310 tablet_bootstrap.cc:492] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe: Bootstrap starting.
I20260808 07:07:27.810199 17309 tablet_bootstrap.cc:654] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:27.810516 17310 tablet_bootstrap.cc:654] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:27.810519 17311 tablet_bootstrap.cc:492] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a: Bootstrap starting.
I20260808 07:07:27.810808 17309 tablet_bootstrap.cc:492] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c: No bootstrap required, opened a new log
I20260808 07:07:27.810963 17309 ts_tablet_manager.cc:1397] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:27.811167 17309 raft_consensus.cc:348] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:27.811307 17309 raft_consensus.cc:374] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:27.811342 17309 raft_consensus.cc:729] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 917200053dbe44b5a2894f29554f333c, State: Initialized, Role: FOLLOWER
I20260808 07:07:27.811419 17310 tablet_bootstrap.cc:492] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe: No bootstrap required, opened a new log
I20260808 07:07:27.811398 17309 consensus_queue.cc:260] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:27.811476 17310 ts_tablet_manager.cc:1397] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:27.811621 17309 ts_tablet_manager.cc:1428] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:27.811652 17310 raft_consensus.cc:348] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:27.811729 17310 raft_consensus.cc:374] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:27.811764 17310 raft_consensus.cc:729] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a21e18e8d94b480c885a3aabd893cfbe, State: Initialized, Role: FOLLOWER
I20260808 07:07:27.812093 17315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.811803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.3:34869)
0808 07:07:27.811956 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.811999 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":110,"threads_started":1}
I20260808 07:07:27.812294 17311 tablet_bootstrap.cc:654] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:27.812474 17315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.812383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.3:46587)
0808 07:07:27.812421 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.812448 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260808 07:07:27.811846 17310 consensus_queue.cc:260] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:27.812878 17213 heartbeater.cc:503] Master 127.9.94.60:45487 was elected leader, sending a full tablet report...
I20260808 07:07:27.813045 17311 tablet_bootstrap.cc:492] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a: No bootstrap required, opened a new log
I20260808 07:07:27.813030 17310 ts_tablet_manager.cc:1428] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:07:27.813089 17311 ts_tablet_manager.cc:1397] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 07:07:27.813230 17311 raft_consensus.cc:348] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:27.813395 17311 raft_consensus.cc:374] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:27.813443 17311 raft_consensus.cc:729] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd63449a17f7409b8c30bb83298a571a, State: Initialized, Role: FOLLOWER
I20260808 07:07:27.813512 17311 consensus_queue.cc:260] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:27.813714 17311 ts_tablet_manager.cc:1428] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:27.814126 17069 heartbeater.cc:503] Master 127.9.94.60:45487 was elected leader, sending a full tablet report...
I20260808 07:07:27.814229 17318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.813367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.1:40003)
0808 07:07:27.814129 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.814178 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":737,"thread_start_us":85,"threads_started":1}
I20260808 07:07:27.814357 16923 heartbeater.cc:503] Master 127.9.94.60:45487 was elected leader, sending a full tablet report...
I20260808 07:07:27.814806 17320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.813910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.2:56625)
0808 07:07:27.814711 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.814755 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":774,"thread_start_us":82,"threads_started":1}
I20260808 07:07:27.815137 17318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:27.815033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.1:58501)
0808 07:07:27.815081 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:27.815104 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 07:07:27.902735 17216 tablet.cc:2369] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:07:28.062425 16926 tablet.cc:2369] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:07:28.099117 17319 raft_consensus.cc:482] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:28.099234 17319 raft_consensus.cc:504] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:28.099675 17319 leader_election.cc:288] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 917200053dbe44b5a2894f29554f333c (127.9.94.3:40387), a21e18e8d94b480c885a3aabd893cfbe (127.9.94.1:38695)
I20260808 07:07:28.104552 17305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:28.100040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:57003 (local address 127.9.94.3:40387)
0808 07:07:28.100115 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:28.100118 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:28.100205 (+ 87us) server_negotiation.cc:407] Connection header received
0808 07:07:28.100334 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:28.100335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:28.100351 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:28.100422 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:28.100681 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:28.101560 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:28.103219 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:28.103882 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:28.103971 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:28.103987 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:28.104425 (+ 438us) server_negotiation.cc:299] Negotiation successful
0808 07:07:28.104475 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 07:07:28.104552 17306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:28.100100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:34677 (local address 127.9.94.1:38695)
0808 07:07:28.100151 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:28.100153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:28.100312 (+ 159us) server_negotiation.cc:407] Connection header received
0808 07:07:28.100352 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:28.100353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:28.100364 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:28.100423 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:28.100682 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:28.101556 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:28.103220 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:28.103882 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:28.103971 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:28.103986 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:28.104425 (+ 439us) server_negotiation.cc:299] Negotiation successful
0808 07:07:28.104475 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 07:07:28.104545 17320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:28.099946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:40387 (local address 127.9.94.2:57003)
0808 07:07:28.100125 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:28.100138 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:28.100212 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:28.100453 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:28.100454 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:28.100460 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:28.100559 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:28.100561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:28.101688 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:28.101688 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:28.103094 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:28.103098 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:28.104198 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:28.104199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:28.104297 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:28.104301 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:28.104363 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 07:07:28.104418 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":122}
I20260808 07:07:28.104557 17321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:28.099951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:38695 (local address 127.9.94.2:34677)
0808 07:07:28.100227 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:28.100237 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:28.100300 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:28.100453 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:28.100454 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:28.100456 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:28.100556 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:28.100558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:28.101687 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:28.101688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:28.103094 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:28.103098 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:28.104173 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:28.104174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:28.104263 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:28.104269 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:07:28.104350 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 07:07:28.104418 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":134,"thread_start_us":138,"threads_started":1}
I20260808 07:07:28.105134 17165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4537510658749518741f596a47032b8" candidate_uuid: "bd63449a17f7409b8c30bb83298a571a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917200053dbe44b5a2894f29554f333c" is_pre_election: true
I20260808 07:07:28.105299 17165 raft_consensus.cc:2454] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd63449a17f7409b8c30bb83298a571a in term 0.
I20260808 07:07:28.105541 16875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4537510658749518741f596a47032b8" candidate_uuid: "bd63449a17f7409b8c30bb83298a571a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21e18e8d94b480c885a3aabd893cfbe" is_pre_election: true
I20260808 07:07:28.105626 16875 raft_consensus.cc:2454] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd63449a17f7409b8c30bb83298a571a in term 0.
I20260808 07:07:28.105559 16949 leader_election.cc:302] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 917200053dbe44b5a2894f29554f333c, bd63449a17f7409b8c30bb83298a571a; no voters:
I20260808 07:07:28.105791 17319 raft_consensus.cc:2781] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:28.105847 17319 raft_consensus.cc:482] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:28.105863 17319 raft_consensus.cc:3037] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:28.106663 17319 raft_consensus.cc:504] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:28.106959 17319 leader_election.cc:288] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [CANDIDATE]: Term 1 election: Requested vote from peers 917200053dbe44b5a2894f29554f333c (127.9.94.3:40387), a21e18e8d94b480c885a3aabd893cfbe (127.9.94.1:38695)
I20260808 07:07:28.107072 17165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4537510658749518741f596a47032b8" candidate_uuid: "bd63449a17f7409b8c30bb83298a571a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "917200053dbe44b5a2894f29554f333c"
I20260808 07:07:28.107074 16875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4537510658749518741f596a47032b8" candidate_uuid: "bd63449a17f7409b8c30bb83298a571a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21e18e8d94b480c885a3aabd893cfbe"
I20260808 07:07:28.107175 16875 raft_consensus.cc:3037] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:28.107183 17165 raft_consensus.cc:3037] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:28.108114 16875 raft_consensus.cc:2454] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd63449a17f7409b8c30bb83298a571a in term 1.
I20260808 07:07:28.108295 17165 raft_consensus.cc:2454] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd63449a17f7409b8c30bb83298a571a in term 1.
I20260808 07:07:28.108541 16951 leader_election.cc:302] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a21e18e8d94b480c885a3aabd893cfbe, bd63449a17f7409b8c30bb83298a571a; no voters:
I20260808 07:07:28.108690 17319 raft_consensus.cc:2781] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:28.109037 17319 raft_consensus.cc:686] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [term 1 LEADER]: Becoming Leader. State: Replica: bd63449a17f7409b8c30bb83298a571a, State: Running, Role: LEADER
I20260808 07:07:28.109133 17319 consensus_queue.cc:237] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } }
I20260808 07:07:28.109480 17321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:28.109336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.2:49779)
0808 07:07:28.109398 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:28.109441 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 07:07:28.110051 16737 catalog_manager.cc:5495] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a reported cstate change: term changed from 0 to 1, leader changed from <none> to bd63449a17f7409b8c30bb83298a571a (127.9.94.2). New cstate: current_term: 1 leader_uuid: "bd63449a17f7409b8c30bb83298a571a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd63449a17f7409b8c30bb83298a571a" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40391 } health_report { overall_health: HEALTHY } } }
I20260808 07:07:28.166076 17308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:28.163261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34898 (local address 127.9.94.2:40391)
0808 07:07:28.163360 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:28.163362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:28.163371 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:28.163420 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:28.163421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:28.163442 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:28.163511 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:28.163741 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:28.164276 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:28.165086 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:28.165298 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:28.165361 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:28.165596 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:28.165705 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:28.165776 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:28.165980 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 07:07:28.166004 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 07:07:28.167511 16875 raft_consensus.cc:1261] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe [term 1 FOLLOWER]: Refusing update from remote peer bd63449a17f7409b8c30bb83298a571a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:28.167532 17165 raft_consensus.cc:1261] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c [term 1 FOLLOWER]: Refusing update from remote peer bd63449a17f7409b8c30bb83298a571a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:28.167939 17322 consensus_queue.cc:1035] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [LEADER]: Connected to new peer: Peer: permanent_uuid: "917200053dbe44b5a2894f29554f333c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:28.168074 17319 consensus_queue.cc:1035] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a21e18e8d94b480c885a3aabd893cfbe" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:28.169251 17315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:28.169109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.3:52739)
0808 07:07:28.169172 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:28.169213 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 07:07:28.170210 17318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:28.170063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.1:48367)
0808 07:07:28.170141 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:28.170172 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 07:07:28.170574 17321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:28.170443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.2:34879)
0808 07:07:28.170509 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:28.170542 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 07:07:28.170686 17315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:28.170576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.3:49271)
0808 07:07:28.170617 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:28.170651 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 07:07:28.172259 17321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:28.172130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.2:51683)
0808 07:07:28.172195 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:28.172223 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 07:07:28.172639 17326 mvcc.cc:205] Tried to move back new op lower bound from 7316163986091282432 to 7316163985855819776. Current Snapshot: MvccSnapshot[applied={T|T < 7316163986091282432 or (T in {7316163986091282432})}]
I20260808 07:07:28.172799 17318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:28.172682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45719 (local address 127.9.94.1:38149)
0808 07:07:28.172745 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:28.172772 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 07:07:28.173396 16737 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59318:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:28.173501 16737 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59318:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:28.174929 16737 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b531398de4348b1901b6b063033f0cd: Sending DeleteTablet for 3 replicas of tablet e4537510658749518741f596a47032b8
I20260808 07:07:28.175272 17145 tablet_service.cc:1514] Processing DeleteTablet for tablet e4537510658749518741f596a47032b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:28 UTC) from {username='oryx', principal='oryx/127.9.94.60@KRBTEST.COM'} at 127.0.0.1:37538
I20260808 07:07:28.175324 17001 tablet_service.cc:1514] Processing DeleteTablet for tablet e4537510658749518741f596a47032b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:28 UTC) from {username='oryx', principal='oryx/127.9.94.60@KRBTEST.COM'} at 127.0.0.1:34892
I20260808 07:07:28.175604 17336 tablet_replica.cc:330] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c: stopping tablet replica
I20260808 07:07:28.175621 16854 tablet_service.cc:1514] Processing DeleteTablet for tablet e4537510658749518741f596a47032b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:28 UTC) from {username='oryx', principal='oryx/127.9.94.60@KRBTEST.COM'} at 127.0.0.1:33702
I20260808 07:07:28.175661 17336 raft_consensus.cc:2229] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:28.175700 17336 raft_consensus.cc:2258] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:28.175901 17338 tablet_replica.cc:330] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe: stopping tablet replica
I20260808 07:07:28.175969 17338 raft_consensus.cc:2229] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:28.176014 17338 raft_consensus.cc:2258] T e4537510658749518741f596a47032b8 P a21e18e8d94b480c885a3aabd893cfbe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:28.176051 17336 ts_tablet_manager.cc:1905] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:28.176076 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 16694
I20260808 07:07:28.178483 17337 tablet_replica.cc:330] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a: stopping tablet replica
I20260808 07:07:28.178617 17337 raft_consensus.cc:2229] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:07:28.178781 17336 ts_tablet_manager.cc:1918] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:28.178851 17336 log.cc:1196] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/e4537510658749518741f596a47032b8
I20260808 07:07:28.178808 17337 raft_consensus.cc:2258] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:28.179160 17336 ts_tablet_manager.cc:1939] T e4537510658749518741f596a47032b8 P 917200053dbe44b5a2894f29554f333c: Deleting consensus metadata
I20260808 07:07:28.179317 17337 ts_tablet_manager.cc:1905] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:28.179752 16721 catalog_manager.cc:4841] TS 917200053dbe44b5a2894f29554f333c (127.9.94.3:40387): tablet e4537510658749518741f596a47032b8 (table test-table [id=723b24eae57a4c5a82f6deea7e5f2a57]) successfully deleted
I20260808 07:07:28.181131 17337 ts_tablet_manager.cc:1918] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:28.181212 17337 log.cc:1196] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/e4537510658749518741f596a47032b8
I20260808 07:07:28.181478 17337 ts_tablet_manager.cc:1939] T e4537510658749518741f596a47032b8 P bd63449a17f7409b8c30bb83298a571a: Deleting consensus metadata
I20260808 07:07:28.181840 16723 catalog_manager.cc:4841] TS bd63449a17f7409b8c30bb83298a571a (127.9.94.2:40391): tablet e4537510658749518741f596a47032b8 (table test-table [id=723b24eae57a4c5a82f6deea7e5f2a57]) successfully deleted
W20260808 07:07:28.185901 17307 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:28.185736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:38695 (local address 127.0.0.1:33712)
0808 07:07:28.185799 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:28.185830 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:38695: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 07:07:28.186086 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 16931
W20260808 07:07:28.186250 16723 catalog_manager.cc:4584] TS a21e18e8d94b480c885a3aabd893cfbe (127.9.94.1:38695): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e4537510658749518741f596a47032b8: Network error: Client connection negotiation failed: client connection to 127.9.94.1:38695: connect: Connection reset by peer (error 104)
I20260808 07:07:28.193105 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 17076
I20260808 07:07:28.200649 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 16400
I20260808 07:07:28.207871 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 16595
2026-08-08T07:07:28Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5220 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:07:28 dist-test-slave-77v9 krb5kdc[17341](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:07:28 dist-test-slave-77v9 krb5kdc[17341](info): set up 2 sockets
Aug 08 07:07:28 dist-test-slave-77v9 krb5kdc[17341](info): commencing operation
krb5kdc: starting...
W20260808 07:07:29.391084 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:07:29 dist-test-slave-77v9 krb5kdc[17341](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:07:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:29Z Disabled control of system clock
WARNING: no policy specified for oryx/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.62.keytab.
Entry for principal oryx/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.62.keytab.
I20260808 07:07:29.546406 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:45753
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.62.keytab
--principal=oryx/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:45753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:29.636665 17355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:29.636996 17355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:29.637048 17355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:29.638370 17355 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:29.638445 17355 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 07:07:29.638470 17355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:29.638496 17355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:29.638531 17355 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:29.638558 17355 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:29.640314 17355 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:45753
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.62.keytab
--principal=oryx/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:45753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:29.640632 17355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:29.640928 17355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:29.646835 17361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:29.646790 17363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:29.646792 17360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:29.646879 17355 server_base.cc:1034] running on GCE node
I20260808 07:07:29.647789 17355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:29.648126 17355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:29.649325 17355 hybrid_clock.cc:648] HybridClock initialized: now 1786172849649292 us; error 43 us; skew 500 ppm
Aug 08 07:07:29 dist-test-slave-77v9 krb5kdc[17341](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172849, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:29.653095 17355 init.cc:377] Logged in from keytab as oryx/127.9.94.62@KRBTEST.COM (short username oryx)
I20260808 07:07:29.653599 17355 webserver.cc:460] Webserver started at http://127.9.94.62:33455/ using document root <none> and password file <none>
I20260808 07:07:29.653829 17355 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:29.653888 17355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:29.653985 17355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:29.655046 17355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "97477d4ec41f41528837ca46fcab25e4"
format_stamp: "Formatted at 2026-08-08 07:07:29 on dist-test-slave-77v9"
server_key: "f990232c8269faf1a5c19a9e51fa2419"
server_key_iv: "fdf2f99a22cc8b04f08eb5216b7a3be6"
server_key_version: "encryptionkey@0"
I20260808 07:07:29.655352 17355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "97477d4ec41f41528837ca46fcab25e4"
format_stamp: "Formatted at 2026-08-08 07:07:29 on dist-test-slave-77v9"
server_key: "f990232c8269faf1a5c19a9e51fa2419"
server_key_iv: "fdf2f99a22cc8b04f08eb5216b7a3be6"
server_key_version: "encryptionkey@0"
I20260808 07:07:29.656800 17355 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:07:29.658046 17370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:29.658280 17355 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:29.658449 17355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "97477d4ec41f41528837ca46fcab25e4"
format_stamp: "Formatted at 2026-08-08 07:07:29 on dist-test-slave-77v9"
server_key: "f990232c8269faf1a5c19a9e51fa2419"
server_key_iv: "fdf2f99a22cc8b04f08eb5216b7a3be6"
server_key_version: "encryptionkey@0"
I20260808 07:07:29.658541 17355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:29.674642 17355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:29.677306 17355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:29.677440 17355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:29.682268 17355 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:45753
I20260808 07:07:29.682341 17435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:45753 every 8 connection(s)
I20260808 07:07:29.682744 17355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:29.683120 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 17355
I20260808 07:07:29.683235 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:29.683450 9592 external_mini_cluster.cc:1428] Setting key d3ba0906a843d0db8febb0b47bd00e33
I20260808 07:07:29.683580 17436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:29.686967 17436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4: Bootstrap starting.
I20260808 07:07:29.687659 17436 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:29.687997 17436 log.cc:824] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:29.688835 17436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4: No bootstrap required, opened a new log
I20260808 07:07:29.690737 17436 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97477d4ec41f41528837ca46fcab25e4" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45753 } }
I20260808 07:07:29.690912 17436 raft_consensus.cc:374] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:29.690963 17436 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97477d4ec41f41528837ca46fcab25e4, State: Initialized, Role: FOLLOWER
Aug 08 07:07:29 dist-test-slave-77v9 krb5kdc[17341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
I20260808 07:07:29.691124 17436 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97477d4ec41f41528837ca46fcab25e4" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45753 } }
I20260808 07:07:29.691212 17436 raft_consensus.cc:388] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:29.691249 17436 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:29.691320 17436 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:29.691964 17436 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97477d4ec41f41528837ca46fcab25e4" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45753 } }
I20260808 07:07:29.692090 17436 leader_election.cc:302] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97477d4ec41f41528837ca46fcab25e4; no voters:
I20260808 07:07:29.692281 17436 leader_election.cc:288] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:29.692319 17441 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:29.692587 17436 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:29.692780 17441 raft_consensus.cc:686] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [term 1 LEADER]: Becoming Leader. State: Replica: 97477d4ec41f41528837ca46fcab25e4, State: Running, Role: LEADER
I20260808 07:07:29.693003 17441 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97477d4ec41f41528837ca46fcab25e4" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45753 } }
I20260808 07:07:29.693753 17443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97477d4ec41f41528837ca46fcab25e4. Latest consensus state: current_term: 1 leader_uuid: "97477d4ec41f41528837ca46fcab25e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97477d4ec41f41528837ca46fcab25e4" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45753 } } }
I20260808 07:07:29.693866 17443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:29.694139 17456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:29.694209 17442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "97477d4ec41f41528837ca46fcab25e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97477d4ec41f41528837ca46fcab25e4" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45753 } } }
I20260808 07:07:29.694355 17442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:29.694833 17456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:29.696094 17439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:29.684061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46082 (local address 127.9.94.62:45753)
0808 07:07:29.684269 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:29.684279 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:29.684314 (+ 35us) server_negotiation.cc:407] Connection header received
0808 07:07:29.684752 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:29.684772 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:29.684862 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:29.685019 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:29.685816 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:29.687221 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:29.688192 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:29.688697 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:29.688866 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:29.691597 (+ 2731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:29.691601 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:29.691602 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:29.691612 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:29.693785 (+ 2173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:29.694721 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:29.694724 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:29.694724 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:29.694851 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:29.695091 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:29.695091 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:29.695092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:29.695407 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:29.695553 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:29.695732 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 07:07:29.695874 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":106,"threads_started":1}
I20260808 07:07:29.696480 17456 catalog_manager.cc:1347] Generated new cluster ID: 63e711aeeb124c2bb213c29067c990f9
I20260808 07:07:29.696529 17456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:29.701279 17456 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:29.702075 17456 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:29.715443 17456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4: Generated new TSK 0
I20260808 07:07:29.715688 17456 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.1.keytab.
Entry for principal oryx/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.1.keytab.
I20260808 07:07:29.754372 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:45753
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.1.keytab
--principal=oryx/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:29.847575 17462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:29.847827 17462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:29.847859 17462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:29.849130 17462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:29.849181 17462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:29.849203 17462 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:07:29.849222 17462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:29.850951 17462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.1.keytab
--principal=oryx/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.94.62:45753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:29.851227 17462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:29.851498 17462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:29.857509 17467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:29.857532 17468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:29.857640 17470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:29.857923 17462 server_base.cc:1034] running on GCE node
I20260808 07:07:29.858192 17462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:29.858507 17462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:29.859710 17462 hybrid_clock.cc:648] HybridClock initialized: now 1786172849859675 us; error 48 us; skew 500 ppm
Aug 08 07:07:29 dist-test-slave-77v9 krb5kdc[17341](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172849, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:29.863162 17462 init.cc:377] Logged in from keytab as oryx/127.9.94.1@KRBTEST.COM (short username oryx)
I20260808 07:07:29.863842 17462 webserver.cc:460] Webserver started at http://127.9.94.1:43425/ using document root <none> and password file <none>
I20260808 07:07:29.864131 17462 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:29.864207 17462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:29.864392 17462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:29.865607 17462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "24c3a3f5b2ef40afa5548d0923c887dd"
format_stamp: "Formatted at 2026-08-08 07:07:29 on dist-test-slave-77v9"
server_key: "33fa3a843002e5d4f9202d8f528a3f47"
server_key_iv: "9d73bc29e55f555b8ef9798ed55bb4f5"
server_key_version: "encryptionkey@0"
I20260808 07:07:29.865989 17462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "24c3a3f5b2ef40afa5548d0923c887dd"
format_stamp: "Formatted at 2026-08-08 07:07:29 on dist-test-slave-77v9"
server_key: "33fa3a843002e5d4f9202d8f528a3f47"
server_key_iv: "9d73bc29e55f555b8ef9798ed55bb4f5"
server_key_version: "encryptionkey@0"
I20260808 07:07:29.867553 17462 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:07:29.868535 17477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:29.868968 17462 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:29.869093 17462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "24c3a3f5b2ef40afa5548d0923c887dd"
format_stamp: "Formatted at 2026-08-08 07:07:29 on dist-test-slave-77v9"
server_key: "33fa3a843002e5d4f9202d8f528a3f47"
server_key_iv: "9d73bc29e55f555b8ef9798ed55bb4f5"
server_key_version: "encryptionkey@0"
I20260808 07:07:29.869182 17462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:29.884941 17462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:29.887672 17462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:29.887940 17462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:29.889314 17462 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:29.889379 17462 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:29.889446 17462 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:29.889516 17462 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:07:29 dist-test-slave-77v9 krb5kdc[17341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172849, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
I20260808 07:07:29.897897 17462 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:40245
I20260808 07:07:29.898016 17596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:40245 every 8 connection(s)
I20260808 07:07:29.898535 17462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:07:29.901125 17439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:29.889183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:55075 (local address 127.9.94.62:45753)
0808 07:07:29.889242 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:29.889245 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:29.889459 (+ 214us) server_negotiation.cc:407] Connection header received
0808 07:07:29.890209 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:29.890211 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:29.890224 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:29.890287 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:29.890912 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:29.891718 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:29.893843 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:29.894092 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:29.894185 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:29.897269 (+ 3084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:29.897271 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:29.897271 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:29.897281 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:29.899272 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:29.899762 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:29.899763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:29.899764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:29.899844 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:29.900166 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:29.900167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:29.900167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:29.900317 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:29.900387 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:29.900944 (+ 557us) server_negotiation.cc:299] Negotiation successful
0808 07:07:29.901050 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:07:29.901378 17485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:29.889143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45753 (local address 127.9.94.1:55075)
0808 07:07:29.889304 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:29.889346 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:29.890092 (+ 746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:29.890368 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:29.890371 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:29.890616 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:29.890804 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:29.890807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:29.891838 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:29.891840 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:29.893719 (+ 1879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:29.893723 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:29.894179 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:29.894181 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:29.894359 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:29.895011 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:29.895028 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:29.897132 (+ 2104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:29.899412 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:29.899418 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:29.899420 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:29.899650 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:29.899948 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:29.899950 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:29.899950 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:29.900060 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:29.900416 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:29.900422 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:29.900557 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 07:07:29.900672 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 07:07:29.901068 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
I20260808 07:07:29.901701 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 17462
I20260808 07:07:29.901831 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:29.902076 9592 external_mini_cluster.cc:1428] Setting key 19d010ae1a28cffed30a07a578a0156d
I20260808 07:07:29.902376 17597 heartbeater.cc:347] Connected to a master server at 127.9.94.62:45753
I20260808 07:07:29.902472 17597 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:29.902916 17597 heartbeater.cc:511] Master 127.9.94.62:45753 requested a full tablet report, sending...
I20260808 07:07:29.903491 17385 ts_manager.cc:194] Registered new tserver with Master: 24c3a3f5b2ef40afa5548d0923c887dd (127.9.94.1:40245)
I20260808 07:07:29.904173 17385 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:55075
WARNING: no policy specified for oryx/127.9.94.2@KRBTEST.COM; defaulting to no policy
I20260808 07:07:29.913028 17603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:29.904551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45753 (local address 127.9.94.1:39655)
0808 07:07:29.904974 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:29.904987 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:29.905084 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:29.905285 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:29.905286 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:29.905587 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:29.905675 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:29.905677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:29.906562 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:29.906563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:29.907465 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:29.907469 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:29.907874 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:29.907875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:29.907953 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:29.908640 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:29.908646 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:29.909226 (+ 580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:29.911653 (+ 2427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:29.911654 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:29.911655 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:29.911912 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:29.912185 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:29.912186 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:29.912186 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:29.912256 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:29.912570 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:29.912571 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:29.912624 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 07:07:29.912736 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 07:07:29.912893 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":79,"threads_started":1}
I20260808 07:07:29.913043 17439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:29.904614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:39655 (local address 127.9.94.62:45753)
0808 07:07:29.904894 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:29.904897 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:29.905050 (+ 153us) server_negotiation.cc:407] Connection header received
0808 07:07:29.905164 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:29.905166 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:29.905178 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:29.905211 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:29.905787 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:29.906381 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:29.907567 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:29.907780 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:29.907849 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:29.909413 (+ 1564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:29.909416 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:29.909417 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:29.909428 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:29.911550 (+ 2122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:29.912023 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:29.912025 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:29.912025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:29.912105 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:29.912331 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:29.912332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:29.912332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:29.912458 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:29.912561 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:29.912770 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 07:07:29.912948 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.2.keytab.
Entry for principal oryx/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.2.keytab.
I20260808 07:07:29.937829 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:45753
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.2.keytab
--principal=oryx/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:30.030997 17606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:30.031275 17606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:30.031317 17606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:30.032557 17606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:30.032637 17606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:30.032673 17606 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:07:30.032712 17606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:30.034475 17606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.2.keytab
--principal=oryx/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.94.62:45753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:30.034780 17606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:30.035050 17606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:30.041049 17612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:30.041071 17606 server_base.cc:1034] running on GCE node
W20260808 07:07:30.041049 17611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:30.041051 17614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:30.041617 17606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:30.041973 17606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:30.043203 17606 hybrid_clock.cc:648] HybridClock initialized: now 1786172850043167 us; error 61 us; skew 500 ppm
Aug 08 07:07:30 dist-test-slave-77v9 krb5kdc[17341](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172850, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:30.046546 17606 init.cc:377] Logged in from keytab as oryx/127.9.94.2@KRBTEST.COM (short username oryx)
I20260808 07:07:30.047068 17606 webserver.cc:460] Webserver started at http://127.9.94.2:43317/ using document root <none> and password file <none>
I20260808 07:07:30.047291 17606 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:30.047338 17606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:30.047451 17606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:30.048609 17606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "8384f41568a04956aefa9b37f779f66c"
format_stamp: "Formatted at 2026-08-08 07:07:30 on dist-test-slave-77v9"
server_key: "b3651ed8e601e6b08172a5c21580b562"
server_key_iv: "dbb5cfa868a6f88b57e77a2b4d55812c"
server_key_version: "encryptionkey@0"
I20260808 07:07:30.049041 17606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "8384f41568a04956aefa9b37f779f66c"
format_stamp: "Formatted at 2026-08-08 07:07:30 on dist-test-slave-77v9"
server_key: "b3651ed8e601e6b08172a5c21580b562"
server_key_iv: "dbb5cfa868a6f88b57e77a2b4d55812c"
server_key_version: "encryptionkey@0"
I20260808 07:07:30.050668 17606 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:30.051538 17621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:30.051867 17606 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:30.051980 17606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "8384f41568a04956aefa9b37f779f66c"
format_stamp: "Formatted at 2026-08-08 07:07:30 on dist-test-slave-77v9"
server_key: "b3651ed8e601e6b08172a5c21580b562"
server_key_iv: "dbb5cfa868a6f88b57e77a2b4d55812c"
server_key_version: "encryptionkey@0"
I20260808 07:07:30.052034 17606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:30.070506 17606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:30.073503 17606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:30.073652 17606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:30.074221 17606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:30.074270 17606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:30.074306 17606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:30.074349 17606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:30.083190 17606 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:32873
I20260808 07:07:30.083290 17740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:32873 every 8 connection(s)
I20260808 07:07:30.083716 17606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:07:30 dist-test-slave-77v9 krb5kdc[17341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172850, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
I20260808 07:07:30.085173 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 17606
I20260808 07:07:30.085352 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:07:30.085613 9592 external_mini_cluster.cc:1428] Setting key 994f34f2cc2bcc9aab588fe83faa9f48
I20260808 07:07:30.088616 17439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.075180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:37431 (local address 127.9.94.62:45753)
0808 07:07:30.075250 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:30.075254 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:30.075506 (+ 252us) server_negotiation.cc:407] Connection header received
0808 07:07:30.076293 (+ 787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:30.076295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:30.076312 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:30.076405 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:30.077452 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.078439 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.080229 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.080586 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.080672 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.084628 (+ 3956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:30.084629 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:30.084630 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:30.084638 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:30.086894 (+ 2256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:30.087396 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:30.087398 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:30.087398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:30.087483 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:30.087786 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:30.087788 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:30.087788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:30.087936 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:30.088047 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:30.088452 (+ 405us) server_negotiation.cc:299] Negotiation successful
0808 07:07:30.088541 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 07:07:30.088975 17630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.075135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45753 (local address 127.9.94.2:37431)
0808 07:07:30.075328 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:30.075411 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:30.076136 (+ 725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:30.076494 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:30.076498 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:30.076961 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:30.077305 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.077318 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.078554 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.078555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.080091 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.080094 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.080682 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.080683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.080939 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.082078 (+ 1139us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:30.082097 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:30.084493 (+ 2396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:30.087008 (+ 2515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:30.087018 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:30.087021 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:30.087300 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:30.087573 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:30.087574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:30.087574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:30.087710 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:30.088024 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:30.088032 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:30.088252 (+ 220us) client_negotiation.cc:769] Sending connection context
0808 07:07:30.088399 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 07:07:30.088619 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":92,"threads_started":1}
I20260808 07:07:30.089550 17741 heartbeater.cc:347] Connected to a master server at 127.9.94.62:45753
I20260808 07:07:30.089671 17741 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:30.089885 17741 heartbeater.cc:511] Master 127.9.94.62:45753 requested a full tablet report, sending...
I20260808 07:07:30.090317 17386 ts_manager.cc:194] Registered new tserver with Master: 8384f41568a04956aefa9b37f779f66c (127.9.94.2:32873)
I20260808 07:07:30.090767 17386 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:37431
WARNING: no policy specified for oryx/127.9.94.3@KRBTEST.COM; defaulting to no policy
I20260808 07:07:30.098927 17439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.090857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:60637 (local address 127.9.94.62:45753)
0808 07:07:30.090971 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:30.090973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:30.092280 (+ 1307us) server_negotiation.cc:407] Connection header received
0808 07:07:30.092396 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:30.092397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:30.092410 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:30.092466 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:30.092852 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.093519 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.094448 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.094681 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.094764 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.095873 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:30.095875 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:30.095876 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:30.095884 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:30.097525 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:30.097954 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:30.097955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:30.097955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:30.098023 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:30.098256 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:30.098257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:30.098258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:30.098437 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:30.098519 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:30.098713 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 07:07:30.098806 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 07:07:30.098940 17749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.090844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45753 (local address 127.9.94.2:60637)
0808 07:07:30.092187 (+ 1343us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:30.092198 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:30.092314 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:30.092469 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:30.092469 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:30.092682 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:30.092737 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.092739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.093626 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.093627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.094339 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.094341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.094764 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.094765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.094843 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.095406 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:30.095411 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:30.095744 (+ 333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:30.097652 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:30.097654 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:30.097654 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:30.097860 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:30.098098 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:30.098099 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:30.098099 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:30.098175 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:30.098522 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:30.098524 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:30.098576 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 07:07:30.098667 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 07:07:30.098800 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1318,"thread_start_us":90,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.3.keytab.
Entry for principal oryx/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.3.keytab.
I20260808 07:07:30.122009 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:45753
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.3.keytab
--principal=oryx/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:30.213076 17751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:30.213338 17751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:30.213378 17751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:30.214663 17751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:30.214720 17751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:30.214742 17751 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:07:30.214761 17751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:30.216557 17751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.3.keytab
--principal=oryx/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.94.62:45753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:30.216841 17751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:30.217100 17751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:30.222855 17759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:30.222855 17756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:30.222859 17757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:30.223286 17751 server_base.cc:1034] running on GCE node
I20260808 07:07:30.223510 17751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:30.223815 17751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:30.224959 17751 hybrid_clock.cc:648] HybridClock initialized: now 1786172850224979 us; error 71 us; skew 500 ppm
Aug 08 07:07:30 dist-test-slave-77v9 krb5kdc[17341](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172850, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:30.228035 17751 init.cc:377] Logged in from keytab as oryx/127.9.94.3@KRBTEST.COM (short username oryx)
I20260808 07:07:30.228559 17751 webserver.cc:460] Webserver started at http://127.9.94.3:37125/ using document root <none> and password file <none>
I20260808 07:07:30.228760 17751 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:30.228896 17751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:30.229082 17751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:30.230296 17751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "00123f49a87f4079954ce6fa7082f00b"
format_stamp: "Formatted at 2026-08-08 07:07:30 on dist-test-slave-77v9"
server_key: "3bc89cb53226b54957e910ee5eb303aa"
server_key_iv: "45d843f3d633cc9e38900622298b8b80"
server_key_version: "encryptionkey@0"
I20260808 07:07:30.230698 17751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "00123f49a87f4079954ce6fa7082f00b"
format_stamp: "Formatted at 2026-08-08 07:07:30 on dist-test-slave-77v9"
server_key: "3bc89cb53226b54957e910ee5eb303aa"
server_key_iv: "45d843f3d633cc9e38900622298b8b80"
server_key_version: "encryptionkey@0"
I20260808 07:07:30.232209 17751 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:07:30.233300 17767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:30.233507 17751 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:30.233601 17751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "00123f49a87f4079954ce6fa7082f00b"
format_stamp: "Formatted at 2026-08-08 07:07:30 on dist-test-slave-77v9"
server_key: "3bc89cb53226b54957e910ee5eb303aa"
server_key_iv: "45d843f3d633cc9e38900622298b8b80"
server_key_version: "encryptionkey@0"
I20260808 07:07:30.233661 17751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:30.262707 17751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:30.265161 17751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:30.265300 17751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:30.265817 17751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:30.265856 17751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:30.265879 17751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:30.265892 17751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:30.273226 17751 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:34229
Aug 08 07:07:30 dist-test-slave-77v9 krb5kdc[17341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172850, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
I20260808 07:07:30.273298 17886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:34229 every 8 connection(s)
I20260808 07:07:30.273695 17751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:07:30.277185 17439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.266480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:51255 (local address 127.9.94.62:45753)
0808 07:07:30.266531 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:30.266533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:30.266786 (+ 253us) server_negotiation.cc:407] Connection header received
0808 07:07:30.267545 (+ 759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:30.267546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:30.267563 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:30.267636 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:30.268596 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.269495 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.270597 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.270948 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.271034 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.273845 (+ 2811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:30.273848 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:30.273848 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:30.273857 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:30.275475 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:30.275944 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:30.275945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:30.275946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:30.276025 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:30.276373 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:30.276374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:30.276374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:30.276524 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:30.276618 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:30.276987 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 07:07:30.277081 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:07:30.277413 17777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.266490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45753 (local address 127.9.94.3:51255)
0808 07:07:30.266661 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:30.266696 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:30.267282 (+ 586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:30.267720 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:30.267724 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:30.268094 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:30.268454 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.268460 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.269621 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.269622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.270485 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.270487 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.271048 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.271048 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.271194 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.271809 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:30.271817 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:30.273751 (+ 1934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:30.275572 (+ 1821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:30.275578 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:30.275579 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:30.275814 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:30.276131 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:30.276132 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:30.276133 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:30.276267 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:30.276607 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:30.276614 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:30.276773 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 07:07:30.276956 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 07:07:30.277141 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":85,"threads_started":1}
I20260808 07:07:30.278025 17887 heartbeater.cc:347] Connected to a master server at 127.9.94.62:45753
I20260808 07:07:30.278112 17887 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:30.278303 17887 heartbeater.cc:511] Master 127.9.94.62:45753 requested a full tablet report, sending...
I20260808 07:07:30.278808 17385 ts_manager.cc:194] Registered new tserver with Master: 00123f49a87f4079954ce6fa7082f00b (127.9.94.3:34229)
I20260808 07:07:30.279284 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 17751
I20260808 07:07:30.279367 17385 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:51255
I20260808 07:07:30.279402 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:07:30.279635 9592 external_mini_cluster.cc:1428] Setting key 11e2b69f180c9f637dc33ac474992980
I20260808 07:07:30.281168 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:07:30.286643 17893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.279241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45753 (local address 127.9.94.3:48399)
0808 07:07:30.279451 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:30.279463 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:30.279610 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:30.279760 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:30.279761 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:30.280001 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:30.280064 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.280066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.280753 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.280753 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.281479 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.281481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.282092 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.282093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.282152 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.282697 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:30.282702 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:30.283014 (+ 312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:30.285485 (+ 2471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:30.285487 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:30.285487 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:30.285683 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:30.285933 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:30.285933 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:30.285933 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:30.285994 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:30.286341 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:30.286342 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:30.286390 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 07:07:30.286470 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 07:07:30.286559 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":88,"threads_started":1}
I20260808 07:07:30.286780 17439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.279297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:48399 (local address 127.9.94.62:45753)
0808 07:07:30.279343 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:30.279345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:30.279516 (+ 171us) server_negotiation.cc:407] Connection header received
0808 07:07:30.279694 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:30.279695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:30.279705 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:30.279756 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:30.280137 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.280663 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.281563 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.281974 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.282079 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.283325 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:30.283328 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:30.283328 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:30.283336 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:30.285332 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:30.285771 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:30.285772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:30.285772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:30.285846 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:30.286065 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:30.286066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:30.286066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:30.286232 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:30.286319 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:30.286523 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 07:07:30.286620 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
Aug 08 07:07:30 dist-test-slave-77v9 krb5kdc[17341](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172850, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 07:07:30 dist-test-slave-77v9 krb5kdc[17341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:30 dist-test-slave-77v9 krb5kdc[17341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 07:07:30.309118 17439 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:30.302563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46088 (local address 127.9.94.62:45753)
0808 07:07:30.302659 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:30.302661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:30.302670 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:30.302699 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:30.302700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:30.302728 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:30.302798 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:30.303675 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.304265 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.305248 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.305498 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.305563 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.309011 (+ 3448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46088: BlockingRecv error: recv got EOF from 127.0.0.1:46088 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 08 07:07:30 dist-test-slave-77v9 krb5kdc[17341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172850, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
I20260808 07:07:30.317766 17439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.309831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46098 (local address 127.9.94.62:45753)
0808 07:07:30.309909 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:30.309911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:30.309972 (+ 61us) server_negotiation.cc:407] Connection header received
0808 07:07:30.310029 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:30.310029 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:30.310037 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:30.310094 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:30.310566 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.311034 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.311841 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.312025 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.312094 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.314698 (+ 2604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:30.314700 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:30.314701 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:30.314710 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:30.316263 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:30.316720 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:30.316721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:30.316722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:30.316871 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:30.317106 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:30.317107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:30.317108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:30.317242 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:30.317389 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:30.317552 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 07:07:30.317644 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 07:07:30.319849 17385 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46098:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:07:30.321960 17385 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:30.329990 17912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.325010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:32873 (local address 127.0.0.1:59102)
0808 07:07:30.325240 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:30.325252 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:30.325321 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:30.325790 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:30.325793 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:30.325795 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:30.325885 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.325887 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.327248 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.327248 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.328514 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.328515 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.329632 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.329633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.329724 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.329740 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 07:07:30.329833 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 07:07:30.329894 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":19,"thread_start_us":74,"threads_started":1}
I20260808 07:07:30.330116 17915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.325145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59102 (local address 127.9.94.2:32873)
0808 07:07:30.325569 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:30.325573 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:30.325582 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:30.325621 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:30.325623 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:30.325639 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:30.325757 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:30.325977 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.327169 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.328641 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.329500 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.329631 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.329725 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:30.329939 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 07:07:30.329987 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":84,"threads_started":1}
I20260808 07:07:30.330454 17913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.325009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:40245 (local address 127.0.0.1:36378)
0808 07:07:30.325204 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:30.325250 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:30.325320 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:30.325916 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:30.325917 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:30.325919 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:30.325979 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.325981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.326992 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.326994 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.328505 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.328508 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.330217 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.330218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.330282 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.330287 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:07:30.330345 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:07:30.330384 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":70,"threads_started":1}
I20260808 07:07:30.330528 17917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.325338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36378 (local address 127.9.94.1:40245)
0808 07:07:30.325515 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:30.325520 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:30.325533 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:07:30.325759 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:30.325762 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:30.325777 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:30.325923 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:30.326040 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.326858 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.328639 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.329500 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.329853 (+ 353us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.330105 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:30.330377 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 07:07:30.330428 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":92,"threads_started":1}
I20260808 07:07:30.330871 17673 tablet_service.cc:1467] Processing CreateTablet for tablet 6cfaa06b6824439a96ea87150100d3ae (DEFAULT_TABLE table=test-table [id=3c99dc0f72e24d529cf74261b00fd92f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:30.331286 17673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cfaa06b6824439a96ea87150100d3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:30.331243 17528 tablet_service.cc:1467] Processing CreateTablet for tablet 6cfaa06b6824439a96ea87150100d3ae (DEFAULT_TABLE table=test-table [id=3c99dc0f72e24d529cf74261b00fd92f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:30.331619 17528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cfaa06b6824439a96ea87150100d3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:30.331867 17916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.325218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:34229 (local address 127.0.0.1:54414)
0808 07:07:30.325596 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:30.325606 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:30.325650 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:30.325945 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:30.325945 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:30.325948 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:30.325994 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.325995 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.328630 (+ 2635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.328630 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.329454 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.329456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.331590 (+ 2134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.331591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.331668 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.331674 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:07:30.331736 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 07:07:30.331782 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":59,"threads_started":1}
I20260808 07:07:30.332149 17918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.325420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54414 (local address 127.9.94.3:34229)
0808 07:07:30.325713 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:30.325717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:30.325727 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:07:30.325793 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:30.325795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:30.325810 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:30.325885 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:30.326072 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.327153 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.329562 (+ 2409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.331473 (+ 1911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.331554 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.331635 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:30.331995 (+ 360us) server_negotiation.cc:299] Negotiation successful
0808 07:07:30.332042 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":94,"threads_started":1}
I20260808 07:07:30.333784 17819 tablet_service.cc:1467] Processing CreateTablet for tablet 6cfaa06b6824439a96ea87150100d3ae (DEFAULT_TABLE table=test-table [id=3c99dc0f72e24d529cf74261b00fd92f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:30.334239 17819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cfaa06b6824439a96ea87150100d3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:30.335448 17919 tablet_bootstrap.cc:492] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c: Bootstrap starting.
I20260808 07:07:30.336287 17921 tablet_bootstrap.cc:492] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd: Bootstrap starting.
I20260808 07:07:30.336392 17919 tablet_bootstrap.cc:654] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:30.336738 17919 log.cc:824] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:30.337011 17921 tablet_bootstrap.cc:654] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:30.337363 17921 log.cc:824] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:30.337709 17919 tablet_bootstrap.cc:492] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c: No bootstrap required, opened a new log
I20260808 07:07:30.337796 17919 ts_tablet_manager.cc:1397] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:07:30.338275 17921 tablet_bootstrap.cc:492] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd: No bootstrap required, opened a new log
I20260808 07:07:30.338418 17921 ts_tablet_manager.cc:1397] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:07:30.338485 17924 tablet_bootstrap.cc:492] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b: Bootstrap starting.
I20260808 07:07:30.339195 17924 tablet_bootstrap.cc:654] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:30.339740 17924 log.cc:824] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:30.339943 17919 raft_consensus.cc:348] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } }
I20260808 07:07:30.340129 17919 raft_consensus.cc:374] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:30.340175 17919 raft_consensus.cc:729] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8384f41568a04956aefa9b37f779f66c, State: Initialized, Role: FOLLOWER
I20260808 07:07:30.340291 17919 consensus_queue.cc:260] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } }
I20260808 07:07:30.340583 17919 ts_tablet_manager.cc:1428] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:07:30.340598 17924 tablet_bootstrap.cc:492] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b: No bootstrap required, opened a new log
I20260808 07:07:30.340631 17741 heartbeater.cc:503] Master 127.9.94.62:45753 was elected leader, sending a full tablet report...
I20260808 07:07:30.340657 17924 ts_tablet_manager.cc:1397] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:07:30.340555 17921 raft_consensus.cc:348] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } }
I20260808 07:07:30.340803 17921 raft_consensus.cc:374] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:30.340883 17921 raft_consensus.cc:729] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24c3a3f5b2ef40afa5548d0923c887dd, State: Initialized, Role: FOLLOWER
I20260808 07:07:30.340997 17921 consensus_queue.cc:260] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } }
I20260808 07:07:30.341265 17921 ts_tablet_manager.cc:1428] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:07:30.341302 17597 heartbeater.cc:503] Master 127.9.94.62:45753 was elected leader, sending a full tablet report...
I20260808 07:07:30.342618 17924 raft_consensus.cc:348] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } }
I20260808 07:07:30.342737 17924 raft_consensus.cc:374] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:30.342756 17924 raft_consensus.cc:729] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00123f49a87f4079954ce6fa7082f00b, State: Initialized, Role: FOLLOWER
I20260808 07:07:30.342828 17924 consensus_queue.cc:260] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } }
I20260808 07:07:30.343012 17924 ts_tablet_manager.cc:1428] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:07:30.343093 17887 heartbeater.cc:503] Master 127.9.94.62:45753 was elected leader, sending a full tablet report...
W20260808 07:07:30.399375 17598 tablet.cc:2369] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:07:30.524497 17888 tablet.cc:2369] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:07:30.556143 17928 raft_consensus.cc:482] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:30.556365 17928 raft_consensus.cc:504] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } }
I20260808 07:07:30.556890 17928 leader_election.cc:288] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8384f41568a04956aefa9b37f779f66c (127.9.94.2:32873), 24c3a3f5b2ef40afa5548d0923c887dd (127.9.94.1:40245)
I20260808 07:07:30.559790 17777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.557068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:40245 (local address 127.9.94.3:35439)
0808 07:07:30.557119 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:30.557133 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:30.557184 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:30.557411 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:30.557411 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:30.557413 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:30.557484 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.557485 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.558172 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.558173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.558946 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.558948 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.559520 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.559521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.559595 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.559598 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:30.559674 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 07:07:30.559717 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 07:07:30.559790 17917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.557233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:35439 (local address 127.9.94.1:40245)
0808 07:07:30.557291 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:30.557293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:30.557300 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:07:30.557323 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:30.557324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:30.557333 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:30.557405 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:30.557564 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.558043 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.559045 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.559424 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.559518 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.559529 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:30.559679 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 07:07:30.559714 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:07:30.560139 17915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.557174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:53775 (local address 127.9.94.2:32873)
0808 07:07:30.557218 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:30.557220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:30.557366 (+ 146us) server_negotiation.cc:407] Connection header received
0808 07:07:30.557435 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:30.557436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:30.557448 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:30.557496 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:30.557670 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.558151 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.559403 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.559768 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.559855 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.559865 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:30.560032 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 07:07:30.560071 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:07:30.560225 17549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cfaa06b6824439a96ea87150100d3ae" candidate_uuid: "00123f49a87f4079954ce6fa7082f00b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" is_pre_election: true
I20260808 07:07:30.560403 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.557072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:32873 (local address 127.9.94.3:53775)
0808 07:07:30.557280 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:30.557290 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:30.557379 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:30.557508 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:30.557509 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:30.557510 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:30.557601 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.557603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.558241 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.558242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.559305 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.559307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.559874 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.559875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.559945 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.559949 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:30.560236 (+ 287us) client_negotiation.cc:240] Negotiation successful
0808 07:07:30.560279 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":32,"thread_start_us":106,"threads_started":1}
I20260808 07:07:30.560408 17549 raft_consensus.cc:2454] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00123f49a87f4079954ce6fa7082f00b in term 0.
I20260808 07:07:30.560695 17770 leader_election.cc:302] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00123f49a87f4079954ce6fa7082f00b, 24c3a3f5b2ef40afa5548d0923c887dd; no voters:
I20260808 07:07:30.560738 17694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cfaa06b6824439a96ea87150100d3ae" candidate_uuid: "00123f49a87f4079954ce6fa7082f00b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8384f41568a04956aefa9b37f779f66c" is_pre_election: true
I20260808 07:07:30.560849 17928 raft_consensus.cc:2781] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:30.560900 17694 raft_consensus.cc:2454] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00123f49a87f4079954ce6fa7082f00b in term 0.
I20260808 07:07:30.560933 17928 raft_consensus.cc:482] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:30.560966 17928 raft_consensus.cc:3037] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:30.561832 17928 raft_consensus.cc:504] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } }
I20260808 07:07:30.561997 17928 leader_election.cc:288] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [CANDIDATE]: Term 1 election: Requested vote from peers 8384f41568a04956aefa9b37f779f66c (127.9.94.2:32873), 24c3a3f5b2ef40afa5548d0923c887dd (127.9.94.1:40245)
I20260808 07:07:30.562127 17694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cfaa06b6824439a96ea87150100d3ae" candidate_uuid: "00123f49a87f4079954ce6fa7082f00b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8384f41568a04956aefa9b37f779f66c"
I20260808 07:07:30.562228 17694 raft_consensus.cc:3037] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:30.562981 17694 raft_consensus.cc:2454] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00123f49a87f4079954ce6fa7082f00b in term 1.
I20260808 07:07:30.563256 17768 leader_election.cc:302] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00123f49a87f4079954ce6fa7082f00b, 8384f41568a04956aefa9b37f779f66c; no voters:
I20260808 07:07:30.563372 17928 raft_consensus.cc:2781] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:30.563400 17549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cfaa06b6824439a96ea87150100d3ae" candidate_uuid: "00123f49a87f4079954ce6fa7082f00b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24c3a3f5b2ef40afa5548d0923c887dd"
I20260808 07:07:30.563530 17928 raft_consensus.cc:686] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [term 1 LEADER]: Becoming Leader. State: Replica: 00123f49a87f4079954ce6fa7082f00b, State: Running, Role: LEADER
I20260808 07:07:30.563498 17549 raft_consensus.cc:3037] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:30.563638 17928 consensus_queue.cc:237] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } }
I20260808 07:07:30.564499 17549 raft_consensus.cc:2454] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00123f49a87f4079954ce6fa7082f00b in term 1.
I20260808 07:07:30.564627 17385 catalog_manager.cc:5495] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b reported cstate change: term changed from 0 to 1, leader changed from <none> to 00123f49a87f4079954ce6fa7082f00b (127.9.94.3). New cstate: current_term: 1 leader_uuid: "00123f49a87f4079954ce6fa7082f00b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } health_report { overall_health: UNKNOWN } } }
W20260808 07:07:30.584611 17742 tablet.cc:2369] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:07:30.618377 17918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.615388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54430 (local address 127.9.94.3:34229)
0808 07:07:30.615479 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:30.615481 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:30.615490 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:30.615526 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:30.615526 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:30.615546 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:30.615615 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:30.615754 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.616427 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.617362 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.617548 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.617608 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.617940 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:30.618058 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:30.618142 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:30.618221 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 07:07:30.618241 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 07:07:30.620472 17549 raft_consensus.cc:1261] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Refusing update from remote peer 00123f49a87f4079954ce6fa7082f00b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:30.620489 17694 raft_consensus.cc:1261] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c [term 1 FOLLOWER]: Refusing update from remote peer 00123f49a87f4079954ce6fa7082f00b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:30.620908 17928 consensus_queue.cc:1035] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:30.621060 17930 consensus_queue.cc:1035] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [LEADER]: Connected to new peer: Peer: permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:30.627144 17385 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:30.627275 17385 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:30.628230 17385 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4: Sending DeleteTablet for 3 replicas of tablet 6cfaa06b6824439a96ea87150100d3ae
I20260808 07:07:30.628670 17673 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cfaa06b6824439a96ea87150100d3ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:30 UTC) from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:59102
I20260808 07:07:30.628739 17528 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cfaa06b6824439a96ea87150100d3ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:30 UTC) from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:36378
I20260808 07:07:30.628918 17819 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cfaa06b6824439a96ea87150100d3ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:30 UTC) from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:54414
I20260808 07:07:30.629009 17945 tablet_replica.cc:330] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd: stopping tablet replica
I20260808 07:07:30.629118 17945 raft_consensus.cc:2229] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:30.629098 17385 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46098:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:07:30.629252 17385 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:30.629249 17946 tablet_replica.cc:330] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b: stopping tablet replica
I20260808 07:07:30.629288 17945 raft_consensus.cc:2258] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:30.629345 17946 raft_consensus.cc:2229] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:07:30.629580 17946 raft_consensus.cc:2258] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:30.629884 17945 ts_tablet_manager.cc:1905] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:30.630050 17946 ts_tablet_manager.cc:1905] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:30.630863 17528 tablet_service.cc:1467] Processing CreateTablet for tablet 8512a58bf95a480aa84dfe163ee31f60 (DEFAULT_TABLE table=test-table [id=b6fb0d739da34a0ca909ab844c26b078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:30.631067 17528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8512a58bf95a480aa84dfe163ee31f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:30.631831 17946 ts_tablet_manager.cc:1918] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:30.631901 17946 log.cc:1196] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/6cfaa06b6824439a96ea87150100d3ae
I20260808 07:07:30.632032 17945 ts_tablet_manager.cc:1918] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:30.632105 17945 log.cc:1196] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/wal/wals/6cfaa06b6824439a96ea87150100d3ae
I20260808 07:07:30.632160 17946 ts_tablet_manager.cc:1939] T 6cfaa06b6824439a96ea87150100d3ae P 00123f49a87f4079954ce6fa7082f00b: Deleting consensus metadata
I20260808 07:07:30.632395 17945 ts_tablet_manager.cc:1939] T 6cfaa06b6824439a96ea87150100d3ae P 24c3a3f5b2ef40afa5548d0923c887dd: Deleting consensus metadata
I20260808 07:07:30.632539 17921 tablet_bootstrap.cc:492] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd: Bootstrap starting.
I20260808 07:07:30.632790 17371 catalog_manager.cc:4841] TS 00123f49a87f4079954ce6fa7082f00b (127.9.94.3:34229): tablet 6cfaa06b6824439a96ea87150100d3ae (table test-table [id=3c99dc0f72e24d529cf74261b00fd92f]) successfully deleted
I20260808 07:07:30.632897 17372 catalog_manager.cc:4841] TS 24c3a3f5b2ef40afa5548d0923c887dd (127.9.94.1:40245): tablet 6cfaa06b6824439a96ea87150100d3ae (table test-table [id=3c99dc0f72e24d529cf74261b00fd92f]) successfully deleted
I20260808 07:07:30.632965 17819 tablet_service.cc:1467] Processing CreateTablet for tablet 8512a58bf95a480aa84dfe163ee31f60 (DEFAULT_TABLE table=test-table [id=b6fb0d739da34a0ca909ab844c26b078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:30.633000 17921 tablet_bootstrap.cc:654] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:30.633013 17673 tablet_service.cc:1467] Processing CreateTablet for tablet 8512a58bf95a480aa84dfe163ee31f60 (DEFAULT_TABLE table=test-table [id=b6fb0d739da34a0ca909ab844c26b078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:30.633065 17819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8512a58bf95a480aa84dfe163ee31f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:30.633123 17673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8512a58bf95a480aa84dfe163ee31f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:30.633644 17921 tablet_bootstrap.cc:492] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd: No bootstrap required, opened a new log
I20260808 07:07:30.633692 17921 ts_tablet_manager.cc:1397] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:30.633844 17921 raft_consensus.cc:348] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:30.633913 17921 raft_consensus.cc:374] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:30.633937 17921 raft_consensus.cc:729] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24c3a3f5b2ef40afa5548d0923c887dd, State: Initialized, Role: FOLLOWER
I20260808 07:07:30.634004 17921 consensus_queue.cc:260] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:30.634123 17921 ts_tablet_manager.cc:1428] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:30.634397 17924 tablet_bootstrap.cc:492] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b: Bootstrap starting.
I20260808 07:07:30.634449 17919 tablet_bootstrap.cc:492] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c: Bootstrap starting.
I20260808 07:07:30.634842 17924 tablet_bootstrap.cc:654] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:30.634861 17919 tablet_bootstrap.cc:654] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:30.635198 17944 tablet_replica.cc:330] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c: stopping tablet replica
I20260808 07:07:30.635320 17944 raft_consensus.cc:2229] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:30.635448 17944 raft_consensus.cc:2258] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:30.635512 17919 tablet_bootstrap.cc:492] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c: No bootstrap required, opened a new log
I20260808 07:07:30.635560 17919 ts_tablet_manager.cc:1397] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:30.635727 17919 raft_consensus.cc:348] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:30.635820 17919 raft_consensus.cc:374] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:30.635845 17919 raft_consensus.cc:729] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8384f41568a04956aefa9b37f779f66c, State: Initialized, Role: FOLLOWER
I20260808 07:07:30.635891 17919 consensus_queue.cc:260] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:30.635931 17924 tablet_bootstrap.cc:492] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b: No bootstrap required, opened a new log
I20260808 07:07:30.635978 17924 ts_tablet_manager.cc:1397] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:07:30.635994 17919 ts_tablet_manager.cc:1428] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:07:30.636111 17924 raft_consensus.cc:348] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:30.636183 17924 raft_consensus.cc:374] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:30.636210 17924 raft_consensus.cc:729] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00123f49a87f4079954ce6fa7082f00b, State: Initialized, Role: FOLLOWER
I20260808 07:07:30.636250 17924 consensus_queue.cc:260] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:30.636332 17924 ts_tablet_manager.cc:1428] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:30.636428 17944 ts_tablet_manager.cc:1905] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:30.638427 17944 ts_tablet_manager.cc:1918] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:30.638667 17944 log.cc:1196] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/6cfaa06b6824439a96ea87150100d3ae
I20260808 07:07:30.639564 17944 ts_tablet_manager.cc:1939] T 6cfaa06b6824439a96ea87150100d3ae P 8384f41568a04956aefa9b37f779f66c: Deleting consensus metadata
I20260808 07:07:30.640218 17371 catalog_manager.cc:4841] TS 8384f41568a04956aefa9b37f779f66c (127.9.94.2:32873): tablet 6cfaa06b6824439a96ea87150100d3ae (table test-table [id=3c99dc0f72e24d529cf74261b00fd92f]) successfully deleted
I20260808 07:07:30.903260 17926 raft_consensus.cc:482] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:30.903378 17926 raft_consensus.cc:504] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:30.903741 17926 leader_election.cc:288] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24c3a3f5b2ef40afa5548d0923c887dd (127.9.94.1:40245), 00123f49a87f4079954ce6fa7082f00b (127.9.94.3:34229)
I20260808 07:07:30.908550 17918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.904094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:38477 (local address 127.9.94.3:34229)
0808 07:07:30.904151 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:30.904153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:30.904238 (+ 85us) server_negotiation.cc:407] Connection header received
0808 07:07:30.904298 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:30.904299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:30.904310 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:30.904406 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:30.904659 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.905526 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.907445 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.908044 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.908131 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.908143 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:30.908430 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 07:07:30.908477 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:07:30.908550 17917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.904088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:49843 (local address 127.9.94.1:40245)
0808 07:07:30.904149 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:30.904151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:30.904237 (+ 86us) server_negotiation.cc:407] Connection header received
0808 07:07:30.904299 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:30.904299 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:30.904310 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:30.904398 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:30.904659 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.905530 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.907446 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.908044 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.908131 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.908143 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:30.908430 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 07:07:30.908477 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:07:30.908560 17950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.903994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:40245 (local address 127.9.94.2:49843)
0808 07:07:30.904144 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:30.904158 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:30.904232 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:30.904422 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:30.904423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:30.904426 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:30.904574 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.904577 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.905650 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.905651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.907296 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.907300 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.908193 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.908194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.908303 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.908307 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:30.908365 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:07:30.908434 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":184,"thread_start_us":75,"threads_started":1}
I20260808 07:07:30.908560 17951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.904003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:34229 (local address 127.9.94.2:38477)
0808 07:07:30.904145 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:30.904158 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:30.904232 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:30.904425 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:30.904425 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:30.904427 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:30.904576 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.904578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.905650 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.905651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.907296 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.907300 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.908169 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.908171 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.908284 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.908291 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 07:07:30.908365 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 07:07:30.908465 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":126,"thread_start_us":69,"threads_started":1}
I20260808 07:07:30.908851 17549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8512a58bf95a480aa84dfe163ee31f60" candidate_uuid: "8384f41568a04956aefa9b37f779f66c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" is_pre_election: true
I20260808 07:07:30.908885 17839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8512a58bf95a480aa84dfe163ee31f60" candidate_uuid: "8384f41568a04956aefa9b37f779f66c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00123f49a87f4079954ce6fa7082f00b" is_pre_election: true
I20260808 07:07:30.908977 17549 raft_consensus.cc:2454] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8384f41568a04956aefa9b37f779f66c in term 0.
I20260808 07:07:30.909032 17839 raft_consensus.cc:2454] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8384f41568a04956aefa9b37f779f66c in term 0.
I20260808 07:07:30.909144 17623 leader_election.cc:302] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24c3a3f5b2ef40afa5548d0923c887dd, 8384f41568a04956aefa9b37f779f66c; no voters:
I20260808 07:07:30.909283 17926 raft_consensus.cc:2781] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:30.909319 17926 raft_consensus.cc:482] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:30.909360 17926 raft_consensus.cc:3037] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:30.910108 17926 raft_consensus.cc:504] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:30.910275 17926 leader_election.cc:288] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [CANDIDATE]: Term 1 election: Requested vote from peers 24c3a3f5b2ef40afa5548d0923c887dd (127.9.94.1:40245), 00123f49a87f4079954ce6fa7082f00b (127.9.94.3:34229)
I20260808 07:07:30.910456 17549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8512a58bf95a480aa84dfe163ee31f60" candidate_uuid: "8384f41568a04956aefa9b37f779f66c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24c3a3f5b2ef40afa5548d0923c887dd"
I20260808 07:07:30.910539 17549 raft_consensus.cc:3037] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:30.911119 17549 raft_consensus.cc:2454] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8384f41568a04956aefa9b37f779f66c in term 1.
I20260808 07:07:30.911356 17623 leader_election.cc:302] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24c3a3f5b2ef40afa5548d0923c887dd, 8384f41568a04956aefa9b37f779f66c; no voters:
I20260808 07:07:30.911350 17839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8512a58bf95a480aa84dfe163ee31f60" candidate_uuid: "8384f41568a04956aefa9b37f779f66c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00123f49a87f4079954ce6fa7082f00b"
I20260808 07:07:30.911441 17839 raft_consensus.cc:3037] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:30.911501 17926 raft_consensus.cc:2781] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:30.911705 17926 raft_consensus.cc:686] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [term 1 LEADER]: Becoming Leader. State: Replica: 8384f41568a04956aefa9b37f779f66c, State: Running, Role: LEADER
I20260808 07:07:30.911845 17926 consensus_queue.cc:237] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:30.912489 17839 raft_consensus.cc:2454] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8384f41568a04956aefa9b37f779f66c in term 1.
I20260808 07:07:30.912696 17385 catalog_manager.cc:5495] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c reported cstate change: term changed from 0 to 1, leader changed from <none> to 8384f41568a04956aefa9b37f779f66c (127.9.94.2). New cstate: current_term: 1 leader_uuid: "8384f41568a04956aefa9b37f779f66c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } health_report { overall_health: UNKNOWN } } }
Aug 08 07:07:30 dist-test-slave-77v9 krb5kdc[17341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172849, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.62@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
I20260808 07:07:30.954350 17959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.945704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:45753 (local address 127.0.0.1:46102)
0808 07:07:30.946052 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:30.946070 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:30.946168 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:30.946414 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:30.946415 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:30.946814 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:30.946871 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.946874 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.947669 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.947670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.948259 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:30.948261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.948725 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.948726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:30.948795 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.949447 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:30.949452 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:30.951171 (+ 1719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:30.953041 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:30.953049 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:30.953054 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:30.953315 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:30.953556 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:30.953557 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:30.953557 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:30.953619 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:30.953965 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:30.953976 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:30.954030 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 07:07:30.954121 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 07:07:30.954264 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":182,"threads_started":1}
I20260808 07:07:30.954625 17960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:30.945826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46102 (local address 127.9.94.62:45753)
0808 07:07:30.946107 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:30.946109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:30.946146 (+ 37us) server_negotiation.cc:407] Connection header received
0808 07:07:30.946267 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:30.946268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:30.946288 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:30.946408 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:30.946980 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.947551 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.948366 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:30.948594 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:30.948712 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:30.951298 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:30.951300 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:30.951300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:30.951307 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:30.952935 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:30.953423 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:30.953424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:30.953424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:30.953486 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:30.953707 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:30.953708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:30.953708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:30.953856 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:30.953927 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:30.954154 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 07:07:30.954355 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":85,"server-negotiator.queue_time_us":250,"thread_start_us":74,"threads_started":1}
I20260808 07:07:30.957293 17385 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:46102:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 07:07:30.957582 17385 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:30.959456 17673 tablet_service.cc:1467] Processing CreateTablet for tablet 226b3a69ba80420f81a1c1b7fb621fe6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=842c3411606740309f9f90ce235dd4cb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:07:30.959465 17819 tablet_service.cc:1467] Processing CreateTablet for tablet 226b3a69ba80420f81a1c1b7fb621fe6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=842c3411606740309f9f90ce235dd4cb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:07:30.959707 17673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 226b3a69ba80420f81a1c1b7fb621fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:30.959725 17819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 226b3a69ba80420f81a1c1b7fb621fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:30.961313 17919 tablet_bootstrap.cc:492] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c: Bootstrap starting.
I20260808 07:07:30.961449 17528 tablet_service.cc:1467] Processing CreateTablet for tablet 226b3a69ba80420f81a1c1b7fb621fe6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=842c3411606740309f9f90ce235dd4cb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:07:30.961531 17924 tablet_bootstrap.cc:492] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b: Bootstrap starting.
I20260808 07:07:30.961618 17528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 226b3a69ba80420f81a1c1b7fb621fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:30.961825 17919 tablet_bootstrap.cc:654] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:30.961831 17924 tablet_bootstrap.cc:654] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:30.962600 17919 tablet_bootstrap.cc:492] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c: No bootstrap required, opened a new log
I20260808 07:07:30.962666 17919 ts_tablet_manager.cc:1397] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:30.962816 17919 raft_consensus.cc:348] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:30.962903 17919 raft_consensus.cc:374] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:30.962925 17919 raft_consensus.cc:729] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8384f41568a04956aefa9b37f779f66c, State: Initialized, Role: FOLLOWER
I20260808 07:07:30.962975 17919 consensus_queue.cc:260] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:30.963093 17919 ts_tablet_manager.cc:1428] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:07:30.963238 17926 tablet_replica.cc:439] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } }
I20260808 07:07:30.963322 17926 tablet_replica.cc:442] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:30.963477 17921 tablet_bootstrap.cc:492] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd: Bootstrap starting.
I20260808 07:07:30.963929 17921 tablet_bootstrap.cc:654] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:30.964413 17924 tablet_bootstrap.cc:492] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b: No bootstrap required, opened a new log
I20260808 07:07:30.964461 17924 ts_tablet_manager.cc:1397] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 07:07:30.964597 17924 raft_consensus.cc:348] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:30.964684 17924 raft_consensus.cc:374] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:30.964681 17921 tablet_bootstrap.cc:492] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd: No bootstrap required, opened a new log
I20260808 07:07:30.964708 17924 raft_consensus.cc:729] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00123f49a87f4079954ce6fa7082f00b, State: Initialized, Role: FOLLOWER
I20260808 07:07:30.964721 17921 ts_tablet_manager.cc:1397] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:30.964756 17924 consensus_queue.cc:260] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:30.964893 17924 ts_tablet_manager.cc:1428] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:07:30.964936 17921 raft_consensus.cc:348] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:30.965013 17921 raft_consensus.cc:374] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:30.965039 17921 raft_consensus.cc:729] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24c3a3f5b2ef40afa5548d0923c887dd, State: Initialized, Role: FOLLOWER
I20260808 07:07:30.965116 17921 consensus_queue.cc:260] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:30.965209 17921 ts_tablet_manager.cc:1428] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:30.965304 17928 tablet_replica.cc:439] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } }
I20260808 07:07:30.965415 17928 tablet_replica.cc:442] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:30.965572 17927 tablet_replica.cc:439] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } }
I20260808 07:07:30.965663 17927 tablet_replica.cc:442] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:31.114157 17927 raft_consensus.cc:482] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:31.114351 17927 raft_consensus.cc:504] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.114969 17927 leader_election.cc:288] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8384f41568a04956aefa9b37f779f66c (127.9.94.2:32873), 00123f49a87f4079954ce6fa7082f00b (127.9.94.3:34229)
I20260808 07:07:31.119131 17964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:31.115281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:32873 (local address 127.9.94.1:34919)
0808 07:07:31.115477 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:31.115491 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:31.115589 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:31.115782 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:31.115783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:31.115785 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:31.115876 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:31.115879 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.116591 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.116592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:31.117757 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:31.117760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.118593 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.118596 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:31.118878 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:31.118886 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 07:07:31.118955 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 07:07:31.119006 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":16,"thread_start_us":105,"threads_started":1}
I20260808 07:07:31.119143 17965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:31.115334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:34919 (local address 127.9.94.2:32873)
0808 07:07:31.115524 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:31.115527 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:31.115564 (+ 37us) server_negotiation.cc:407] Connection header received
0808 07:07:31.115678 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:31.115679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:31.115692 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:31.115758 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:31.115959 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.116499 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.117914 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.118401 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.118478 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:31.118492 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:31.119003 (+ 511us) server_negotiation.cc:299] Negotiation successful
0808 07:07:31.119060 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":115,"threads_started":1}
I20260808 07:07:31.119256 17918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:31.115611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:34923 (local address 127.9.94.3:34229)
0808 07:07:31.115659 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:31.115661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:31.115760 (+ 99us) server_negotiation.cc:407] Connection header received
0808 07:07:31.115788 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:31.115789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:31.115802 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:31.115869 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:31.116090 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.116610 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.117999 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.118610 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.118884 (+ 274us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:31.118903 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:31.119118 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 07:07:31.119184 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:07:31.119551 17966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:31.115512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:34229 (local address 127.9.94.1:34923)
0808 07:07:31.115644 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:31.115655 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:31.115720 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:31.115883 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:31.115884 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:31.115886 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:31.115985 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:31.115987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.116909 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.116910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:31.117874 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:31.117878 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.118894 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.118896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:31.119022 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:31.119027 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:07:31.119093 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 07:07:31.119135 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":1,"thread_start_us":59,"threads_started":1}
I20260808 07:07:31.119513 17694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "226b3a69ba80420f81a1c1b7fb621fe6" candidate_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8384f41568a04956aefa9b37f779f66c" is_pre_election: true
I20260808 07:07:31.119611 17694 raft_consensus.cc:2454] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24c3a3f5b2ef40afa5548d0923c887dd in term 0.
I20260808 07:07:31.119804 17839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "226b3a69ba80420f81a1c1b7fb621fe6" candidate_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00123f49a87f4079954ce6fa7082f00b" is_pre_election: true
I20260808 07:07:31.119899 17839 raft_consensus.cc:2454] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24c3a3f5b2ef40afa5548d0923c887dd in term 0.
I20260808 07:07:31.119858 17478 leader_election.cc:302] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24c3a3f5b2ef40afa5548d0923c887dd, 8384f41568a04956aefa9b37f779f66c; no voters:
I20260808 07:07:31.120045 17927 raft_consensus.cc:2781] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:31.120098 17927 raft_consensus.cc:482] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:31.120124 17927 raft_consensus.cc:3037] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:31.120955 17927 raft_consensus.cc:504] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.121106 17927 leader_election.cc:288] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [CANDIDATE]: Term 1 election: Requested vote from peers 8384f41568a04956aefa9b37f779f66c (127.9.94.2:32873), 00123f49a87f4079954ce6fa7082f00b (127.9.94.3:34229)
I20260808 07:07:31.121263 17694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "226b3a69ba80420f81a1c1b7fb621fe6" candidate_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8384f41568a04956aefa9b37f779f66c"
I20260808 07:07:31.121371 17694 raft_consensus.cc:3037] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:31.121349 17839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "226b3a69ba80420f81a1c1b7fb621fe6" candidate_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00123f49a87f4079954ce6fa7082f00b"
I20260808 07:07:31.121438 17839 raft_consensus.cc:3037] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:31.122310 17839 raft_consensus.cc:2454] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24c3a3f5b2ef40afa5548d0923c887dd in term 1.
I20260808 07:07:31.122301 17694 raft_consensus.cc:2454] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24c3a3f5b2ef40afa5548d0923c887dd in term 1.
I20260808 07:07:31.122495 17478 leader_election.cc:302] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00123f49a87f4079954ce6fa7082f00b, 24c3a3f5b2ef40afa5548d0923c887dd; no voters:
I20260808 07:07:31.122615 17927 raft_consensus.cc:2781] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:31.122813 17927 raft_consensus.cc:686] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 LEADER]: Becoming Leader. State: Replica: 24c3a3f5b2ef40afa5548d0923c887dd, State: Running, Role: LEADER
I20260808 07:07:31.122921 17927 consensus_queue.cc:237] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.123413 17967 tablet_replica.cc:439] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd: TxnStatusTablet state changed. Reason: New leader 24c3a3f5b2ef40afa5548d0923c887dd. Latest consensus state: current_term: 1 leader_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } }
I20260808 07:07:31.123538 17967 tablet_replica.cc:442] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:07:31.123760 17969 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 07:07:31.123906 17969 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 07:07:31.123852 17385 catalog_manager.cc:5495] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 24c3a3f5b2ef40afa5548d0923c887dd (127.9.94.1). New cstate: current_term: 1 leader_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } health_report { overall_health: UNKNOWN } } }
I20260808 07:07:31.151623 17917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:31.148423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36390 (local address 127.9.94.1:40245)
0808 07:07:31.148501 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:31.148503 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:31.148514 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:31.148579 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:31.148580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:31.148600 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:31.148670 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:31.148893 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.149432 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.150715 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.150960 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.151030 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:31.151279 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:31.151381 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:31.151470 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:31.151540 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 07:07:31.151559 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 07:07:31.151696 17959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:31.148318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:40245 (local address 127.0.0.1:36390)
0808 07:07:31.148412 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:31.148426 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:31.148487 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:31.148694 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:31.148694 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:31.148696 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:07:31.148767 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:31.148770 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.149522 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.149523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:31.150616 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:31.150619 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.151052 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.151054 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:31.151123 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:31.151145 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:07:31.151463 (+ 318us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:07:31.151473 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 07:07:31.151538 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 07:07:31.151602 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 07:07:31.153199 17694 raft_consensus.cc:1261] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c [term 1 FOLLOWER]: Refusing update from remote peer 24c3a3f5b2ef40afa5548d0923c887dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:31.153298 17839 raft_consensus.cc:1261] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Refusing update from remote peer 24c3a3f5b2ef40afa5548d0923c887dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:31.153487 17967 consensus_queue.cc:1035] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:31.153600 17927 consensus_queue.cc:1035] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:31.154278 17926 tablet_replica.cc:439] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c: TxnStatusTablet state changed. Reason: New leader 24c3a3f5b2ef40afa5548d0923c887dd. Latest consensus state: current_term: 1 leader_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } }
I20260808 07:07:31.154379 17926 tablet_replica.cc:442] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:31.154325 17928 tablet_replica.cc:439] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b: TxnStatusTablet state changed. Reason: New leader 24c3a3f5b2ef40afa5548d0923c887dd. Latest consensus state: current_term: 1 leader_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } }
I20260808 07:07:31.154420 17928 tablet_replica.cc:442] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:31.155333 17927 tablet_replica.cc:439] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } }
I20260808 07:07:31.155428 17927 tablet_replica.cc:442] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:07:31.155565 17972 mvcc.cc:205] Tried to move back new op lower bound from 7316163998320476160 to 7316163998200012800. Current Snapshot: MvccSnapshot[applied={T|T < 7316163998320476160}]
I20260808 07:07:31.155669 17927 tablet_replica.cc:439] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } }
I20260808 07:07:31.155738 17927 tablet_replica.cc:442] T 226b3a69ba80420f81a1c1b7fb621fe6 P 24c3a3f5b2ef40afa5548d0923c887dd: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:07:31.155841 17928 tablet_replica.cc:439] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } }
I20260808 07:07:31.155932 17928 tablet_replica.cc:442] T 226b3a69ba80420f81a1c1b7fb621fe6 P 00123f49a87f4079954ce6fa7082f00b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:31.156230 17926 tablet_replica.cc:439] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } } }
I20260808 07:07:31.156320 17926 tablet_replica.cc:442] T 226b3a69ba80420f81a1c1b7fb621fe6 P 8384f41568a04956aefa9b37f779f66c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:07:31.156584 17974 mvcc.cc:205] Tried to move back new op lower bound from 7316163998320476160 to 7316163998200012800. Current Snapshot: MvccSnapshot[applied={T|T < 7316163998320476160}]
I20260808 07:07:31.160957 17965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:31.158294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59118 (local address 127.9.94.2:32873)
0808 07:07:31.158360 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:31.158362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:31.158387 (+ 25us) server_negotiation.cc:407] Connection header received
0808 07:07:31.158473 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:31.158474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:31.158494 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:31.158585 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:31.158716 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.159192 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.160029 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.160241 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.160324 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:31.160492 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:31.160605 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:31.160685 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:31.160738 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 07:07:31.160761 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 07:07:31.165982 17917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:31.163465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:43823 (local address 127.9.94.1:40245)
0808 07:07:31.163556 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:31.163559 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:31.163603 (+ 44us) server_negotiation.cc:407] Connection header received
0808 07:07:31.163682 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:31.163683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:31.163693 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:31.163748 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:31.163905 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.164375 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.165258 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.165453 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.165526 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:31.165715 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:31.165755 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:31.165816 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:31.165881 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 07:07:31.165902 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 07:07:31.166023 17984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:31.163377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:40245 (local address 127.9.94.2:43823)
0808 07:07:31.163545 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:31.163558 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:31.163621 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:31.163751 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:31.163751 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:31.163753 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:07:31.163817 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:31.163818 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.164458 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.164459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:31.165156 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:31.165158 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.165539 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.165540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:31.165614 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:31.165627 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:07:31.165830 (+ 203us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:07:31.165832 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:07:31.165880 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 07:07:31.165929 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":96,"threads_started":1}
I20260808 07:07:31.168884 17549 raft_consensus.cc:1261] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Refusing update from remote peer 8384f41568a04956aefa9b37f779f66c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:31.168915 17839 raft_consensus.cc:1261] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Refusing update from remote peer 8384f41568a04956aefa9b37f779f66c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:31.169188 17952 consensus_queue.cc:1035] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [LEADER]: Connected to new peer: Peer: permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:31.169377 17926 consensus_queue.cc:1035] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:31.171154 17973 mvcc.cc:205] Tried to move back new op lower bound from 7316163998385414144 to 7316163997335564288. Current Snapshot: MvccSnapshot[applied={T|T < 7316163998385414144}]
I20260808 07:07:31.180858 17965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:31.177349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:55483 (local address 127.9.94.2:32873)
0808 07:07:31.177420 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:31.177429 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:31.177628 (+ 199us) server_negotiation.cc:407] Connection header received
0808 07:07:31.177693 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:31.177694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:31.177704 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:31.177956 (+ 252us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:31.178168 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.178842 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.179828 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.180121 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.180189 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:31.180512 (+ 323us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:31.180551 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:31.180600 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:31.180680 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 07:07:31.180763 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 07:07:31.180866 17989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:31.177310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:32873 (local address 127.9.94.1:55483)
0808 07:07:31.177552 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:31.177563 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:31.177621 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:31.177983 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:31.177984 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:31.177986 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:07:31.178065 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:31.178067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.179009 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.179009 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:31.179733 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:31.179736 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.180300 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.180301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:31.180389 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:31.180409 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:07:31.180628 (+ 219us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:07:31.180630 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:07:31.180676 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:07:31.180728 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":138,"threads_started":1}
I20260808 07:07:31.192917 17387 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:31.193071 17387 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:31.193974 17387 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4: Sending DeleteTablet for 3 replicas of tablet 8512a58bf95a480aa84dfe163ee31f60
I20260808 07:07:31.194249 17528 tablet_service.cc:1514] Processing DeleteTablet for tablet 8512a58bf95a480aa84dfe163ee31f60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:31 UTC) from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:36378
I20260808 07:07:31.194604 17819 tablet_service.cc:1514] Processing DeleteTablet for tablet 8512a58bf95a480aa84dfe163ee31f60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:31 UTC) from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:54414
I20260808 07:07:31.194942 17995 tablet_replica.cc:330] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b: stopping tablet replica
I20260808 07:07:31.194969 17673 tablet_service.cc:1514] Processing DeleteTablet for tablet 8512a58bf95a480aa84dfe163ee31f60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:31 UTC) from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:59102
I20260808 07:07:31.195032 17995 raft_consensus.cc:2229] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:31.195078 17995 raft_consensus.cc:2258] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:31.195274 17994 tablet_replica.cc:330] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd: stopping tablet replica
I20260808 07:07:31.195382 17994 raft_consensus.cc:2229] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:31.195401 17995 ts_tablet_manager.cc:1905] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:31.195495 17994 raft_consensus.cc:2258] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:31.195823 17994 ts_tablet_manager.cc:1905] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:31.197425 17995 ts_tablet_manager.cc:1918] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:07:31.197501 17995 log.cc:1196] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/8512a58bf95a480aa84dfe163ee31f60
I20260808 07:07:31.197679 17996 tablet_replica.cc:330] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c: stopping tablet replica
I20260808 07:07:31.197780 17995 ts_tablet_manager.cc:1939] T 8512a58bf95a480aa84dfe163ee31f60 P 00123f49a87f4079954ce6fa7082f00b: Deleting consensus metadata
I20260808 07:07:31.197809 17996 raft_consensus.cc:2229] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:07:31.198029 17996 raft_consensus.cc:2258] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:31.198194 17371 catalog_manager.cc:4841] TS 00123f49a87f4079954ce6fa7082f00b (127.9.94.3:34229): tablet 8512a58bf95a480aa84dfe163ee31f60 (table test-table [id=b6fb0d739da34a0ca909ab844c26b078]) successfully deleted
I20260808 07:07:31.198400 17996 ts_tablet_manager.cc:1905] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:31.200253 17996 ts_tablet_manager.cc:1918] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:07:31.200399 17996 log.cc:1196] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/8512a58bf95a480aa84dfe163ee31f60
I20260808 07:07:31.200548 17994 ts_tablet_manager.cc:1918] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:07:31.200625 17994 log.cc:1196] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/wal/wals/8512a58bf95a480aa84dfe163ee31f60
I20260808 07:07:31.200848 17996 ts_tablet_manager.cc:1939] T 8512a58bf95a480aa84dfe163ee31f60 P 8384f41568a04956aefa9b37f779f66c: Deleting consensus metadata
I20260808 07:07:31.200913 17994 ts_tablet_manager.cc:1939] T 8512a58bf95a480aa84dfe163ee31f60 P 24c3a3f5b2ef40afa5548d0923c887dd: Deleting consensus metadata
I20260808 07:07:31.201342 17371 catalog_manager.cc:4841] TS 8384f41568a04956aefa9b37f779f66c (127.9.94.2:32873): tablet 8512a58bf95a480aa84dfe163ee31f60 (table test-table [id=b6fb0d739da34a0ca909ab844c26b078]) successfully deleted
I20260808 07:07:31.201404 17372 catalog_manager.cc:4841] TS 24c3a3f5b2ef40afa5548d0923c887dd (127.9.94.1:40245): tablet 8512a58bf95a480aa84dfe163ee31f60 (table test-table [id=b6fb0d739da34a0ca909ab844c26b078]) successfully deleted
Aug 08 07:07:31 dist-test-slave-77v9 krb5kdc[17341](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172851, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 07:07:31 dist-test-slave-77v9 krb5kdc[17341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:31 dist-test-slave-77v9 krb5kdc[17341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 07:07:31.239126 17960 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:31.231130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46112 (local address 127.9.94.62:45753)
0808 07:07:31.231180 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:31.231183 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:31.231376 (+ 193us) server_negotiation.cc:407] Connection header received
0808 07:07:31.231441 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:31.231442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:31.231458 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:31.231529 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:31.232256 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.233100 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.234442 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.234756 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.234846 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:31.239056 (+ 4210us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46112: BlockingRecv error: recv got EOF from 127.0.0.1:46112 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 08 07:07:31 dist-test-slave-77v9 krb5kdc[17341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172851, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM
I20260808 07:07:31.250129 17960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:31.240076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46118 (local address 127.9.94.62:45753)
0808 07:07:31.240115 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:31.240117 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:31.240389 (+ 272us) server_negotiation.cc:407] Connection header received
0808 07:07:31.240446 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:31.240447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:31.240462 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:31.240520 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:31.241291 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.242046 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.243185 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.243489 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.243569 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:31.246641 (+ 3072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:31.246643 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:31.246644 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:31.246653 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:31.248621 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:31.249114 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:31.249116 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:31.249116 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:31.249189 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:31.249455 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:31.249456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:31.249457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:31.249619 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:31.249730 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:31.249897 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 07:07:31.250010 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:07:31.252233 17387 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46118:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:07:31.252446 17387 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:31.254145 17528 tablet_service.cc:1467] Processing CreateTablet for tablet d5a29800de51404b812a63d2c3215b17 (DEFAULT_TABLE table=test-table [id=da714f475e434fb4a078747ba7fd1e98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:31.254326 17528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a29800de51404b812a63d2c3215b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:31.255841 17921 tablet_bootstrap.cc:492] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd: Bootstrap starting.
I20260808 07:07:31.255944 17673 tablet_service.cc:1467] Processing CreateTablet for tablet d5a29800de51404b812a63d2c3215b17 (DEFAULT_TABLE table=test-table [id=da714f475e434fb4a078747ba7fd1e98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:31.256081 17673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a29800de51404b812a63d2c3215b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:31.256354 17921 tablet_bootstrap.cc:654] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:31.256927 17819 tablet_service.cc:1467] Processing CreateTablet for tablet d5a29800de51404b812a63d2c3215b17 (DEFAULT_TABLE table=test-table [id=da714f475e434fb4a078747ba7fd1e98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:31.257081 17819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a29800de51404b812a63d2c3215b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:31.258515 17924 tablet_bootstrap.cc:492] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b: Bootstrap starting.
I20260808 07:07:31.259025 17924 tablet_bootstrap.cc:654] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:31.259544 17919 tablet_bootstrap.cc:492] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c: Bootstrap starting.
I20260808 07:07:31.260063 17919 tablet_bootstrap.cc:654] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:31.260339 17921 tablet_bootstrap.cc:492] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd: No bootstrap required, opened a new log
I20260808 07:07:31.260407 17921 ts_tablet_manager.cc:1397] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 07:07:31.260543 17924 tablet_bootstrap.cc:492] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b: No bootstrap required, opened a new log
I20260808 07:07:31.260597 17924 ts_tablet_manager.cc:1397] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:07:31.260587 17921 raft_consensus.cc:348] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.260665 17921 raft_consensus.cc:374] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:31.260689 17921 raft_consensus.cc:729] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24c3a3f5b2ef40afa5548d0923c887dd, State: Initialized, Role: FOLLOWER
I20260808 07:07:31.260739 17921 consensus_queue.cc:260] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.260720 17924 raft_consensus.cc:348] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.260852 17924 raft_consensus.cc:374] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:31.260876 17924 raft_consensus.cc:729] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00123f49a87f4079954ce6fa7082f00b, State: Initialized, Role: FOLLOWER
I20260808 07:07:31.260922 17924 consensus_queue.cc:260] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.261004 17921 ts_tablet_manager.cc:1428] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:31.261027 17924 ts_tablet_manager.cc:1428] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:07:31.265511 17919 tablet_bootstrap.cc:492] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c: No bootstrap required, opened a new log
I20260808 07:07:31.265585 17919 ts_tablet_manager.cc:1397] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260808 07:07:31.265736 17919 raft_consensus.cc:348] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.265825 17919 raft_consensus.cc:374] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:31.265851 17919 raft_consensus.cc:729] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8384f41568a04956aefa9b37f779f66c, State: Initialized, Role: FOLLOWER
I20260808 07:07:31.265906 17919 consensus_queue.cc:260] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.266023 17919 ts_tablet_manager.cc:1428] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:07:31.275584 17991 raft_consensus.cc:482] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:31.275686 17991 raft_consensus.cc:504] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.275851 17991 leader_election.cc:288] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24c3a3f5b2ef40afa5548d0923c887dd (127.9.94.1:40245), 00123f49a87f4079954ce6fa7082f00b (127.9.94.3:34229)
I20260808 07:07:31.276541 17839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a29800de51404b812a63d2c3215b17" candidate_uuid: "8384f41568a04956aefa9b37f779f66c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00123f49a87f4079954ce6fa7082f00b" is_pre_election: true
I20260808 07:07:31.276643 17839 raft_consensus.cc:2454] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8384f41568a04956aefa9b37f779f66c in term 0.
I20260808 07:07:31.276849 17549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a29800de51404b812a63d2c3215b17" candidate_uuid: "8384f41568a04956aefa9b37f779f66c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" is_pre_election: true
I20260808 07:07:31.276934 17549 raft_consensus.cc:2454] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8384f41568a04956aefa9b37f779f66c in term 0.
I20260808 07:07:31.277127 17622 leader_election.cc:302] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00123f49a87f4079954ce6fa7082f00b, 8384f41568a04956aefa9b37f779f66c; no voters:
I20260808 07:07:31.277529 17991 raft_consensus.cc:2781] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:31.277580 17991 raft_consensus.cc:482] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:31.277601 17991 raft_consensus.cc:3037] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:31.278570 17991 raft_consensus.cc:504] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.278716 17991 leader_election.cc:288] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [CANDIDATE]: Term 1 election: Requested vote from peers 24c3a3f5b2ef40afa5548d0923c887dd (127.9.94.1:40245), 00123f49a87f4079954ce6fa7082f00b (127.9.94.3:34229)
I20260808 07:07:31.278898 17549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a29800de51404b812a63d2c3215b17" candidate_uuid: "8384f41568a04956aefa9b37f779f66c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24c3a3f5b2ef40afa5548d0923c887dd"
I20260808 07:07:31.278918 17839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a29800de51404b812a63d2c3215b17" candidate_uuid: "8384f41568a04956aefa9b37f779f66c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00123f49a87f4079954ce6fa7082f00b"
I20260808 07:07:31.278991 17549 raft_consensus.cc:3037] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:31.279002 17839 raft_consensus.cc:3037] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:31.279810 17839 raft_consensus.cc:2454] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8384f41568a04956aefa9b37f779f66c in term 1.
I20260808 07:07:31.279814 17549 raft_consensus.cc:2454] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8384f41568a04956aefa9b37f779f66c in term 1.
I20260808 07:07:31.279992 17622 leader_election.cc:302] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00123f49a87f4079954ce6fa7082f00b, 8384f41568a04956aefa9b37f779f66c; no voters:
I20260808 07:07:31.280154 17991 raft_consensus.cc:2781] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:31.280200 17991 raft_consensus.cc:686] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [term 1 LEADER]: Becoming Leader. State: Replica: 8384f41568a04956aefa9b37f779f66c, State: Running, Role: LEADER
I20260808 07:07:31.280246 17991 consensus_queue.cc:237] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.280942 17387 catalog_manager.cc:5495] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c reported cstate change: term changed from 0 to 1, leader changed from <none> to 8384f41568a04956aefa9b37f779f66c (127.9.94.2). New cstate: current_term: 1 leader_uuid: "8384f41568a04956aefa9b37f779f66c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } health_report { overall_health: UNKNOWN } } }
I20260808 07:07:31.294131 17965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:31.290584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59120 (local address 127.9.94.2:32873)
0808 07:07:31.290653 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:31.290655 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:31.290703 (+ 48us) server_negotiation.cc:407] Connection header received
0808 07:07:31.290794 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:31.290795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:31.290807 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:31.290878 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:31.291022 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.291753 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.293103 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:31.293427 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:31.293505 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:31.293798 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:31.293838 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:31.293900 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:31.294018 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 07:07:31.294042 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 07:07:31.295076 17549 raft_consensus.cc:1261] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Refusing update from remote peer 8384f41568a04956aefa9b37f779f66c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:31.295140 17839 raft_consensus.cc:1261] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Refusing update from remote peer 8384f41568a04956aefa9b37f779f66c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:31.295449 17952 consensus_queue.cc:1035] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:31.295809 17952 consensus_queue.cc:1035] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [LEADER]: Connected to new peer: Peer: permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:31.298655 17386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:31.298765 17386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:31.299516 17386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4: Sending DeleteTablet for 3 replicas of tablet d5a29800de51404b812a63d2c3215b17
I20260808 07:07:31.299820 17528 tablet_service.cc:1514] Processing DeleteTablet for tablet d5a29800de51404b812a63d2c3215b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:31 UTC) from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:36378
I20260808 07:07:31.300010 17994 tablet_replica.cc:330] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd: stopping tablet replica
I20260808 07:07:31.300071 17994 raft_consensus.cc:2229] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:31.300112 17994 raft_consensus.cc:2258] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:31.300189 17819 tablet_service.cc:1514] Processing DeleteTablet for tablet d5a29800de51404b812a63d2c3215b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:31 UTC) from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:54414
I20260808 07:07:31.300380 17995 tablet_replica.cc:330] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b: stopping tablet replica
I20260808 07:07:31.300450 17995 raft_consensus.cc:2229] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:31.300505 17995 pending_rounds.cc:62] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b: Trying to abort 2 pending ops.
I20260808 07:07:31.300530 17995 pending_rounds.cc:68] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316163998902542336 op_type: WRITE_OP write_request { tablet_id: "d5a29800de51404b812a63d2c3215b17" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\337\255\333\323\006\"8\n\ntest-admin\022*\n da714f475e434fb4a078747ba7fd1e98\020\001\030\001 \001(\001" signature: "<redacted>""e\266\236\217\377/\266\360\337\336\355\376K<uP\013\003\372CZ_\326\322\'R\275V\r{\037\362\r\264y\364\361]\242\265\334Y\242\021LOR\327\204G\371\372\304\205\2415\356W}}\221Q\277\311" signing_key_seq_num: 0 } } request_id { client_id: "348d3ffcb72c4ac18ff31ca53066f4bb" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260808 07:07:31.300727 17995 pending_rounds.cc:68] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316163998844264448 op_type: NO_OP noop_request { }
I20260808 07:07:31.300786 17995 raft_consensus.cc:2866] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260808 07:07:31.300871 17995 raft_consensus.cc:2258] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:31.301247 17673 tablet_service.cc:1514] Processing DeleteTablet for tablet d5a29800de51404b812a63d2c3215b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:31 UTC) from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:59102
I20260808 07:07:31.301347 17996 tablet_replica.cc:330] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c: stopping tablet replica
I20260808 07:07:31.301399 17996 raft_consensus.cc:2229] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:07:31.301468 17996 raft_consensus.cc:2258] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:31.301470 17386 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46118:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:07:31.301648 17386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:31.301783 17996 ts_tablet_manager.cc:1905] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:31.303339 17819 tablet_service.cc:1467] Processing CreateTablet for tablet 817267602a614c1db341da7cad4a51a8 (DEFAULT_TABLE table=test-table [id=34841f9a10394c828a0693ccbd01a518]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:31.303475 17819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 817267602a614c1db341da7cad4a51a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:31.303665 17996 ts_tablet_manager.cc:1918] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:31.303751 17996 log.cc:1196] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/d5a29800de51404b812a63d2c3215b17
I20260808 07:07:31.303992 17996 ts_tablet_manager.cc:1939] T d5a29800de51404b812a63d2c3215b17 P 8384f41568a04956aefa9b37f779f66c: Deleting consensus metadata
I20260808 07:07:31.304392 17994 ts_tablet_manager.cc:1905] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:31.304890 17924 tablet_bootstrap.cc:492] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b: Bootstrap starting.
W20260808 07:07:31.305128 18017 consensus_queue.cc:1159] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "00123f49a87f4079954ce6fa7082f00b" status { last_received { term: 1 index: 2 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 2 } }
I20260808 07:07:31.305251 17924 tablet_bootstrap.cc:654] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:31.305665 17995 ts_tablet_manager.cc:1905] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:31.305745 17528 tablet_service.cc:1467] Processing CreateTablet for tablet 817267602a614c1db341da7cad4a51a8 (DEFAULT_TABLE table=test-table [id=34841f9a10394c828a0693ccbd01a518]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:31.305861 17528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 817267602a614c1db341da7cad4a51a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:31.306499 17371 catalog_manager.cc:4841] TS 8384f41568a04956aefa9b37f779f66c (127.9.94.2:32873): tablet d5a29800de51404b812a63d2c3215b17 (table test-table [id=da714f475e434fb4a078747ba7fd1e98]) successfully deleted
I20260808 07:07:31.306535 17673 tablet_service.cc:1467] Processing CreateTablet for tablet 817267602a614c1db341da7cad4a51a8 (DEFAULT_TABLE table=test-table [id=34841f9a10394c828a0693ccbd01a518]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:31.306650 17673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 817267602a614c1db341da7cad4a51a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:31.307446 17995 ts_tablet_manager.cc:1918] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:31.307471 17924 tablet_bootstrap.cc:492] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b: No bootstrap required, opened a new log
I20260808 07:07:31.307508 17995 log.cc:1196] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/d5a29800de51404b812a63d2c3215b17
I20260808 07:07:31.307514 17924 ts_tablet_manager.cc:1397] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 07:07:31.307758 17924 raft_consensus.cc:348] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.307847 17924 raft_consensus.cc:374] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:31.307869 17924 raft_consensus.cc:729] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00123f49a87f4079954ce6fa7082f00b, State: Initialized, Role: FOLLOWER
I20260808 07:07:31.307930 17924 consensus_queue.cc:260] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.307955 17919 tablet_bootstrap.cc:492] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c: Bootstrap starting.
I20260808 07:07:31.308015 17924 ts_tablet_manager.cc:1428] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:31.308382 17919 tablet_bootstrap.cc:654] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:31.308938 17994 ts_tablet_manager.cc:1918] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:31.309008 17994 log.cc:1196] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/wal/wals/d5a29800de51404b812a63d2c3215b17
I20260808 07:07:31.307766 17995 ts_tablet_manager.cc:1939] T d5a29800de51404b812a63d2c3215b17 P 00123f49a87f4079954ce6fa7082f00b: Deleting consensus metadata
I20260808 07:07:31.309276 17994 ts_tablet_manager.cc:1939] T d5a29800de51404b812a63d2c3215b17 P 24c3a3f5b2ef40afa5548d0923c887dd: Deleting consensus metadata
I20260808 07:07:31.309448 17371 catalog_manager.cc:4841] TS 00123f49a87f4079954ce6fa7082f00b (127.9.94.3:34229): tablet d5a29800de51404b812a63d2c3215b17 (table test-table [id=da714f475e434fb4a078747ba7fd1e98]) successfully deleted
I20260808 07:07:31.310899 17921 tablet_bootstrap.cc:492] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd: Bootstrap starting.
I20260808 07:07:31.310880 17372 catalog_manager.cc:4841] TS 24c3a3f5b2ef40afa5548d0923c887dd (127.9.94.1:40245): tablet d5a29800de51404b812a63d2c3215b17 (table test-table [id=da714f475e434fb4a078747ba7fd1e98]) successfully deleted
I20260808 07:07:31.311282 17921 tablet_bootstrap.cc:654] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:31.311954 17921 tablet_bootstrap.cc:492] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd: No bootstrap required, opened a new log
I20260808 07:07:31.312013 17921 ts_tablet_manager.cc:1397] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:31.312148 17921 raft_consensus.cc:348] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.312233 17921 raft_consensus.cc:374] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:31.312264 17921 raft_consensus.cc:729] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24c3a3f5b2ef40afa5548d0923c887dd, State: Initialized, Role: FOLLOWER
I20260808 07:07:31.312316 17921 consensus_queue.cc:260] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.312410 17921 ts_tablet_manager.cc:1428] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:07:31.313426 17919 tablet_bootstrap.cc:492] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c: No bootstrap required, opened a new log
I20260808 07:07:31.313485 17919 ts_tablet_manager.cc:1397] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260808 07:07:31.313679 17919 raft_consensus.cc:348] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.313745 17919 raft_consensus.cc:374] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:31.313762 17919 raft_consensus.cc:729] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8384f41568a04956aefa9b37f779f66c, State: Initialized, Role: FOLLOWER
I20260808 07:07:31.313809 17919 consensus_queue.cc:260] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.313890 17919 ts_tablet_manager.cc:1428] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:31.368173 17991 raft_consensus.cc:482] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:31.368300 17991 raft_consensus.cc:504] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.368536 17991 leader_election.cc:288] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24c3a3f5b2ef40afa5548d0923c887dd (127.9.94.1:40245), 00123f49a87f4079954ce6fa7082f00b (127.9.94.3:34229)
I20260808 07:07:31.368852 17839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "817267602a614c1db341da7cad4a51a8" candidate_uuid: "8384f41568a04956aefa9b37f779f66c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00123f49a87f4079954ce6fa7082f00b" is_pre_election: true
I20260808 07:07:31.368868 17549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "817267602a614c1db341da7cad4a51a8" candidate_uuid: "8384f41568a04956aefa9b37f779f66c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" is_pre_election: true
I20260808 07:07:31.368969 17839 raft_consensus.cc:2454] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8384f41568a04956aefa9b37f779f66c in term 0.
I20260808 07:07:31.368969 17549 raft_consensus.cc:2454] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8384f41568a04956aefa9b37f779f66c in term 0.
I20260808 07:07:31.369185 17623 leader_election.cc:302] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24c3a3f5b2ef40afa5548d0923c887dd, 8384f41568a04956aefa9b37f779f66c; no voters:
I20260808 07:07:31.369297 17991 raft_consensus.cc:2781] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:31.369357 17991 raft_consensus.cc:482] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:31.369383 17991 raft_consensus.cc:3037] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:31.370136 17991 raft_consensus.cc:504] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.370436 17991 leader_election.cc:288] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [CANDIDATE]: Term 1 election: Requested vote from peers 24c3a3f5b2ef40afa5548d0923c887dd (127.9.94.1:40245), 00123f49a87f4079954ce6fa7082f00b (127.9.94.3:34229)
I20260808 07:07:31.370667 17549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "817267602a614c1db341da7cad4a51a8" candidate_uuid: "8384f41568a04956aefa9b37f779f66c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24c3a3f5b2ef40afa5548d0923c887dd"
I20260808 07:07:31.370685 17839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "817267602a614c1db341da7cad4a51a8" candidate_uuid: "8384f41568a04956aefa9b37f779f66c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00123f49a87f4079954ce6fa7082f00b"
I20260808 07:07:31.370769 17549 raft_consensus.cc:3037] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:31.370787 17839 raft_consensus.cc:3037] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:31.371425 17839 raft_consensus.cc:2454] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8384f41568a04956aefa9b37f779f66c in term 1.
I20260808 07:07:31.371498 17549 raft_consensus.cc:2454] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8384f41568a04956aefa9b37f779f66c in term 1.
I20260808 07:07:31.371637 17622 leader_election.cc:302] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00123f49a87f4079954ce6fa7082f00b, 8384f41568a04956aefa9b37f779f66c; no voters:
I20260808 07:07:31.371734 17991 raft_consensus.cc:2781] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:31.371817 17991 raft_consensus.cc:686] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [term 1 LEADER]: Becoming Leader. State: Replica: 8384f41568a04956aefa9b37f779f66c, State: Running, Role: LEADER
I20260808 07:07:31.371896 17991 consensus_queue.cc:237] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } }
I20260808 07:07:31.372802 17387 catalog_manager.cc:5495] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c reported cstate change: term changed from 0 to 1, leader changed from <none> to 8384f41568a04956aefa9b37f779f66c (127.9.94.2). New cstate: current_term: 1 leader_uuid: "8384f41568a04956aefa9b37f779f66c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8384f41568a04956aefa9b37f779f66c" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 32873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 } health_report { overall_health: UNKNOWN } } }
I20260808 07:07:31.394091 17839 raft_consensus.cc:1261] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Refusing update from remote peer 8384f41568a04956aefa9b37f779f66c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:31.394091 17549 raft_consensus.cc:1261] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Refusing update from remote peer 8384f41568a04956aefa9b37f779f66c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:31.394423 17926 consensus_queue.cc:1035] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [LEADER]: Connected to new peer: Peer: permanent_uuid: "00123f49a87f4079954ce6fa7082f00b" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:31.394553 17991 consensus_queue.cc:1035] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24c3a3f5b2ef40afa5548d0923c887dd" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:31.407054 17386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:31.407245 17386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:31.408430 17386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 97477d4ec41f41528837ca46fcab25e4: Sending DeleteTablet for 3 replicas of tablet 817267602a614c1db341da7cad4a51a8
I20260808 07:07:31.408757 17528 tablet_service.cc:1514] Processing DeleteTablet for tablet 817267602a614c1db341da7cad4a51a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:31 UTC) from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:36378
I20260808 07:07:31.409017 17819 tablet_service.cc:1514] Processing DeleteTablet for tablet 817267602a614c1db341da7cad4a51a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:31 UTC) from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:54414
I20260808 07:07:31.409054 17673 tablet_service.cc:1514] Processing DeleteTablet for tablet 817267602a614c1db341da7cad4a51a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:31 UTC) from {username='oryx', principal='oryx/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:59102
I20260808 07:07:31.409158 17995 tablet_replica.cc:330] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b: stopping tablet replica
I20260808 07:07:31.409260 17995 raft_consensus.cc:2229] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:31.409292 17996 tablet_replica.cc:330] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c: stopping tablet replica
I20260808 07:07:31.409335 17995 raft_consensus.cc:2258] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:31.409299 17994 tablet_replica.cc:330] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd: stopping tablet replica
I20260808 07:07:31.409359 17996 raft_consensus.cc:2229] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:07:31.409425 17996 raft_consensus.cc:2258] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:31.409432 17994 raft_consensus.cc:2229] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:31.409502 17994 raft_consensus.cc:2258] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:31.409821 17995 ts_tablet_manager.cc:1905] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:31.409960 17994 ts_tablet_manager.cc:1905] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:31.410298 17996 ts_tablet_manager.cc:1905] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:31.411674 17995 ts_tablet_manager.cc:1918] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:07:31.411723 17995 log.cc:1196] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/817267602a614c1db341da7cad4a51a8
I20260808 07:07:31.411700 17994 ts_tablet_manager.cc:1918] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:07:31.411773 17994 log.cc:1196] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-0/wal/wals/817267602a614c1db341da7cad4a51a8
I20260808 07:07:31.411984 17995 ts_tablet_manager.cc:1939] T 817267602a614c1db341da7cad4a51a8 P 00123f49a87f4079954ce6fa7082f00b: Deleting consensus metadata
I20260808 07:07:31.412014 17994 ts_tablet_manager.cc:1939] T 817267602a614c1db341da7cad4a51a8 P 24c3a3f5b2ef40afa5548d0923c887dd: Deleting consensus metadata
I20260808 07:07:31.412029 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 17462
I20260808 07:07:31.412771 17371 catalog_manager.cc:4841] TS 00123f49a87f4079954ce6fa7082f00b (127.9.94.3:34229): tablet 817267602a614c1db341da7cad4a51a8 (table test-table [id=34841f9a10394c828a0693ccbd01a518]) successfully deleted
I20260808 07:07:31.416319 17996 ts_tablet_manager.cc:1918] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:07:31.416383 17996 log.cc:1196] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/817267602a614c1db341da7cad4a51a8
I20260808 07:07:31.416646 17996 ts_tablet_manager.cc:1939] T 817267602a614c1db341da7cad4a51a8 P 8384f41568a04956aefa9b37f779f66c: Deleting consensus metadata
I20260808 07:07:31.417282 17371 catalog_manager.cc:4841] TS 8384f41568a04956aefa9b37f779f66c (127.9.94.2:32873): tablet 817267602a614c1db341da7cad4a51a8 (table test-table [id=34841f9a10394c828a0693ccbd01a518]) successfully deleted
W20260808 07:07:31.421959 17372 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:40245 (error 108)
I20260808 07:07:31.422801 18025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:31.422567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:40245 (local address 127.0.0.1:36396)
0808 07:07:31.422712 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:31.422765 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:40245: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":80,"threads_started":1}
I20260808 07:07:31.422776 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 17606
W20260808 07:07:31.424476 17372 catalog_manager.cc:4584] TS 24c3a3f5b2ef40afa5548d0923c887dd (127.9.94.1:40245): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 817267602a614c1db341da7cad4a51a8: Network error: Client connection negotiation failed: client connection to 127.9.94.1:40245: connect: Connection refused (error 111)
I20260808 07:07:31.432610 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 17751
I20260808 07:07:31.440506 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 17355
2026-08-08T07:07:31Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3233 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:07:31 dist-test-slave-77v9 krb5kdc[18028](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:07:31 dist-test-slave-77v9 krb5kdc[18028](info): set up 2 sockets
Aug 08 07:07:31 dist-test-slave-77v9 krb5kdc[18028](info): commencing operation
krb5kdc: starting...
W20260808 07:07:32.612342 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:07:32 dist-test-slave-77v9 krb5kdc[18028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:07:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:07:32.766059 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:34241
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:43711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:34241
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:32.859972 18044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:32.860255 18044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:32.860293 18044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:32.861553 18044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:32.861629 18044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:32.861653 18044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:32.861677 18044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:32.861704 18044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:32.863304 18044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:43711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:34241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:34241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:32.863603 18044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:32.863862 18044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:07:32.869612 18044 server_base.cc:1034] running on GCE node
W20260808 07:07:32.869503 18049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:32.869572 18050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:32.869503 18052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:32.869997 18044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:32.870273 18044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:32.871450 18044 hybrid_clock.cc:648] HybridClock initialized: now 1786172852871427 us; error 35 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T07:07:32Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1441 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:07:32 dist-test-slave-77v9 krb5kdc[18057](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:07:32 dist-test-slave-77v9 krb5kdc[18057](info): set up 2 sockets
Aug 08 07:07:32 dist-test-slave-77v9 krb5kdc[18057](info): commencing operation
krb5kdc: starting...
W20260808 07:07:34.006942 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:07:34 dist-test-slave-77v9 krb5kdc[18057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:07:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:07:34.153857 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:39891
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:39891
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:34.246042 18070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:34.246264 18070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:34.246289 18070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:34.247387 18070 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:34.247431 18070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:34.247447 18070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:34.247459 18070 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:34.247471 18070 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:34.248909 18070 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:39891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:39891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:34.249102 18070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:34.249284 18070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:34.254875 18077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:34.254870 18076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:34.254901 18070 server_base.cc:1034] running on GCE node
W20260808 07:07:34.254911 18079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:34.255421 18070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:34.255743 18070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:34.256906 18070 hybrid_clock.cc:648] HybridClock initialized: now 1786172854256875 us; error 43 us; skew 500 ppm
Aug 08 07:07:34 dist-test-slave-77v9 krb5kdc[18057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172854, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:34.259608 18070 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:07:34.260186 18070 webserver.cc:460] Webserver started at http://127.9.94.62:40743/ using document root <none> and password file <none>
I20260808 07:07:34.260452 18070 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:34.260524 18070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:34.260679 18070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:34.261902 18070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "22d955572a2743d28cb31c6bafed4446"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "2deb3638a43648ead71bbeaa4aabd091"
server_key_iv: "17ca258a2c8f79970b9cceba6f035bc3"
server_key_version: "encryptionkey@0"
I20260808 07:07:34.262290 18070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "22d955572a2743d28cb31c6bafed4446"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "2deb3638a43648ead71bbeaa4aabd091"
server_key_iv: "17ca258a2c8f79970b9cceba6f035bc3"
server_key_version: "encryptionkey@0"
I20260808 07:07:34.263693 18070 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:07:34.264551 18086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:34.264882 18070 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:34.264991 18070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "22d955572a2743d28cb31c6bafed4446"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "2deb3638a43648ead71bbeaa4aabd091"
server_key_iv: "17ca258a2c8f79970b9cceba6f035bc3"
server_key_version: "encryptionkey@0"
I20260808 07:07:34.265086 18070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:34.276151 18070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:34.278568 18070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:34.278752 18070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:34.283322 18070 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:39891
I20260808 07:07:34.283362 18139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:39891 every 8 connection(s)
I20260808 07:07:34.283732 18070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:34.284718 18140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:34.287339 18140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446: Bootstrap starting.
I20260808 07:07:34.288049 18140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:34.288456 18140 log.cc:824] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:34.289333 18140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446: No bootstrap required, opened a new log
I20260808 07:07:34.290416 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 18070
I20260808 07:07:34.290534 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:34.290745 9592 external_mini_cluster.cc:1428] Setting key 07c11c128e1c62c0fd3194806081fabb
I20260808 07:07:34.291505 18140 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22d955572a2743d28cb31c6bafed4446" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39891 } }
I20260808 07:07:34.291673 18140 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:34.291723 18140 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22d955572a2743d28cb31c6bafed4446, State: Initialized, Role: FOLLOWER
I20260808 07:07:34.291877 18140 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22d955572a2743d28cb31c6bafed4446" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39891 } }
I20260808 07:07:34.291975 18140 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:34.292034 18140 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:34.292088 18140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:34.293080 18140 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22d955572a2743d28cb31c6bafed4446" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39891 } }
I20260808 07:07:34.293205 18140 leader_election.cc:302] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22d955572a2743d28cb31c6bafed4446; no voters:
I20260808 07:07:34.293426 18140 leader_election.cc:288] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:34.293453 18145 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:34.293577 18145 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 1 LEADER]: Becoming Leader. State: Replica: 22d955572a2743d28cb31c6bafed4446, State: Running, Role: LEADER
I20260808 07:07:34.293731 18140 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:34.293730 18145 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22d955572a2743d28cb31c6bafed4446" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39891 } }
I20260808 07:07:34.294324 18146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22d955572a2743d28cb31c6bafed4446" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22d955572a2743d28cb31c6bafed4446" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39891 } } }
I20260808 07:07:34.294430 18146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:34.294956 18154 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:34.295097 18147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22d955572a2743d28cb31c6bafed4446. Latest consensus state: current_term: 1 leader_uuid: "22d955572a2743d28cb31c6bafed4446" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22d955572a2743d28cb31c6bafed4446" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39891 } } }
I20260808 07:07:34.295233 18147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:34.295557 18154 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:34.297935 18154 catalog_manager.cc:1347] Generated new cluster ID: 385bb3d65a7a4c27a8da9da6e5f4efb1
I20260808 07:07:34.298002 18154 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:07:34 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:34.302983 18144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:34.291342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60350 (local address 127.9.94.62:39891)
0808 07:07:34.291538 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:34.291546 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:34.291571 (+ 25us) server_negotiation.cc:407] Connection header received
0808 07:07:34.291667 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:34.291671 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:34.291744 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:34.291927 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:34.292641 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:34.293941 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:34.294941 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:34.295550 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:34.295661 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:34.298977 (+ 3316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:34.298980 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:34.298981 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:34.298993 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:34.301115 (+ 2122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:34.301549 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:34.301552 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:34.301552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:34.301675 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:34.301936 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:34.301937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:34.301937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:34.302235 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:34.302405 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:34.302521 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 07:07:34.302759 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":109,"threads_started":1}
I20260808 07:07:34.305290 18154 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:34.305994 18154 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:34.316253 18154 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446: Generated new TSK 0
I20260808 07:07:34.316532 18154 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:07:34.353211 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39891
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:34.441402 18166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:34.441654 18166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:34.441699 18166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:34.442917 18166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:34.442986 18166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:34.443033 18166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:34.444804 18166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:34.445130 18166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:34.445426 18166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:34.450960 18174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:34.450965 18171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:34.450964 18172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:34.451098 18166 server_base.cc:1034] running on GCE node
I20260808 07:07:34.451546 18166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:34.451802 18166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:34.453163 18166 hybrid_clock.cc:648] HybridClock initialized: now 1786172854453153 us; error 37 us; skew 500 ppm
Aug 08 07:07:34 dist-test-slave-77v9 krb5kdc[18057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172854, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:34.455960 18166 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:07:34.456463 18166 webserver.cc:460] Webserver started at http://127.9.94.1:34395/ using document root <none> and password file <none>
I20260808 07:07:34.456728 18166 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:34.456845 18166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:34.457135 18166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:34.458763 18166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "c39a63064fbf423e80eac6651c34b9d1"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "84373d1737366fd77e5ef9284e1ba7c4"
server_key_iv: "1a520c2268c09669a6d84f02547d8b93"
server_key_version: "encryptionkey@0"
I20260808 07:07:34.459206 18166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "c39a63064fbf423e80eac6651c34b9d1"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "84373d1737366fd77e5ef9284e1ba7c4"
server_key_iv: "1a520c2268c09669a6d84f02547d8b93"
server_key_version: "encryptionkey@0"
I20260808 07:07:34.462406 18166 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260808 07:07:34.463709 18181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:34.464040 18166 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:34.464155 18166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "c39a63064fbf423e80eac6651c34b9d1"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "84373d1737366fd77e5ef9284e1ba7c4"
server_key_iv: "1a520c2268c09669a6d84f02547d8b93"
server_key_version: "encryptionkey@0"
I20260808 07:07:34.464253 18166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:34.474985 18166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:34.477437 18166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:34.477612 18166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:34.477877 18166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:34.478217 18166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:34.478277 18166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:34.478324 18166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:34.478358 18166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:34.484388 18166 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:39709
I20260808 07:07:34.484432 18299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:39709 every 8 connection(s)
I20260808 07:07:34.484776 18166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:07:34.489981 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 18166
I20260808 07:07:34.490106 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:34.490298 9592 external_mini_cluster.cc:1428] Setting key ae1d173d1d1c45fd5474d30264318dee
Aug 08 07:07:34 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172854, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:34.494985 18144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:34.485590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:34827 (local address 127.9.94.62:39891)
0808 07:07:34.485667 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:34.485673 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:34.485920 (+ 247us) server_negotiation.cc:407] Connection header received
0808 07:07:34.486457 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:34.486458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:34.486470 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:34.486537 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:34.487484 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:34.488001 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:34.489017 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:34.489222 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:34.489281 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:34.491871 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:34.491872 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:34.491873 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:34.491884 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:34.493379 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:34.493897 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:34.493898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:34.493899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:34.493961 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:34.494275 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:34.494276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:34.494276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:34.494402 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:34.494475 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:34.494771 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 07:07:34.494892 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 07:07:34.495203 18302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:34.485557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:34827)
0808 07:07:34.485743 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:34.485786 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:34.486304 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:34.486592 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:34.486595 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:34.487176 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:34.487379 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:34.487383 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:34.488090 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:34.488090 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:34.488943 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:34.488945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:34.489302 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:34.489303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:34.489413 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:34.490069 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:34.490079 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:34.491761 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:34.493489 (+ 1728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:34.493496 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:34.493498 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:34.493752 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:34.494036 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:34.494037 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:34.494037 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:34.494218 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:34.494479 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:34.494487 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:34.494630 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 07:07:34.494735 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 07:07:34.494913 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":104,"threads_started":1}
I20260808 07:07:34.495723 18300 heartbeater.cc:347] Connected to a master server at 127.9.94.62:39891
I20260808 07:07:34.495822 18300 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:34.496029 18300 heartbeater.cc:511] Master 127.9.94.62:39891 requested a full tablet report, sending...
I20260808 07:07:34.496642 18104 ts_manager.cc:194] Registered new tserver with Master: c39a63064fbf423e80eac6651c34b9d1 (127.9.94.1:39709)
I20260808 07:07:34.497675 18104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:34827
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:07:34.522109 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39891
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:34.611714 18305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:34.612005 18305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:34.612052 18305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:34.613396 18305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:34.613476 18305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:34.613529 18305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:34.615358 18305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:34.615677 18305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:34.616001 18305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:34.622954 18313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:34.623011 18305 server_base.cc:1034] running on GCE node
W20260808 07:07:34.623039 18310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:34.622964 18311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:34.623445 18305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:34.623757 18305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:34.624958 18305 hybrid_clock.cc:648] HybridClock initialized: now 1786172854624937 us; error 47 us; skew 500 ppm
Aug 08 07:07:34 dist-test-slave-77v9 krb5kdc[18057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172854, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:34.628014 18305 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:07:34.628588 18305 webserver.cc:460] Webserver started at http://127.9.94.2:32855/ using document root <none> and password file <none>
I20260808 07:07:34.628938 18305 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:34.629024 18305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:34.629209 18305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:34.630446 18305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "2730f443dc7c419f9833dd77e3962ab5"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "01d7e5241f298634c1624a9f82d232b2"
server_key_iv: "0e9c95140c2551a60eb50947d81e8981"
server_key_version: "encryptionkey@0"
I20260808 07:07:34.630862 18305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "2730f443dc7c419f9833dd77e3962ab5"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "01d7e5241f298634c1624a9f82d232b2"
server_key_iv: "0e9c95140c2551a60eb50947d81e8981"
server_key_version: "encryptionkey@0"
I20260808 07:07:34.632405 18305 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:07:34.633530 18320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:34.633808 18305 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:07:34.633946 18305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "2730f443dc7c419f9833dd77e3962ab5"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "01d7e5241f298634c1624a9f82d232b2"
server_key_iv: "0e9c95140c2551a60eb50947d81e8981"
server_key_version: "encryptionkey@0"
I20260808 07:07:34.634014 18305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:34.660125 18305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:34.662834 18305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:34.662974 18305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:34.663197 18305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:34.663565 18305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:34.663605 18305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:34.663654 18305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:34.663684 18305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:34.670732 18305 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:38815
I20260808 07:07:34.670820 18438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:38815 every 8 connection(s)
I20260808 07:07:34.671128 18305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:07:34 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172854, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:34.679306 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 18305
I20260808 07:07:34.679502 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:07:34.679780 9592 external_mini_cluster.cc:1428] Setting key 2bfdcf0e3503ac1eeb4860b5a8f81898
I20260808 07:07:34.682602 18144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:34.672042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:60813 (local address 127.9.94.62:39891)
0808 07:07:34.672129 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:34.672132 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:34.672426 (+ 294us) server_negotiation.cc:407] Connection header received
0808 07:07:34.672991 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:34.672992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:34.673015 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:34.673085 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:34.674196 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:34.674768 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:34.675915 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:34.676148 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:34.676211 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:34.678788 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:34.678789 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:34.678789 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:34.678798 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:34.680974 (+ 2176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:34.681386 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:34.681387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:34.681388 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:34.681457 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:34.681675 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:34.681676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:34.681676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:34.681825 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:34.681897 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:34.682358 (+ 461us) server_negotiation.cc:299] Negotiation successful
0808 07:07:34.682467 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 07:07:34.682971 18441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:34.672009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:60813)
0808 07:07:34.672260 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:34.672298 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:34.672780 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:34.673201 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:34.673205 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:34.673872 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:34.674074 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:34.674079 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:34.674887 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:34.674888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:34.675778 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:34.675780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:34.676234 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:34.676234 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:34.676349 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:34.676994 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:34.677003 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:34.678515 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:34.681055 (+ 2540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:34.681061 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:34.681063 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:34.681299 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:34.681522 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:34.681523 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:34.681523 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:34.681613 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:34.682079 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:34.682085 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:34.682212 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 07:07:34.682314 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 07:07:34.682483 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":129,"threads_started":1}
I20260808 07:07:34.683461 18439 heartbeater.cc:347] Connected to a master server at 127.9.94.62:39891
I20260808 07:07:34.683578 18439 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:34.683764 18439 heartbeater.cc:511] Master 127.9.94.62:39891 requested a full tablet report, sending...
I20260808 07:07:34.684221 18104 ts_manager.cc:194] Registered new tserver with Master: 2730f443dc7c419f9833dd77e3962ab5 (127.9.94.2:38815)
I20260808 07:07:34.684746 18104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:60813
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:07:34.713951 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39891
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:34.805364 18444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:34.805577 18444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:34.805604 18444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:34.806726 18444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:34.806763 18444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:34.806790 18444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:34.808187 18444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:39891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18444
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:34.808380 18444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:34.808565 18444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:34.814256 18450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:34.814242 18452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:34.814239 18449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:34.814283 18444 server_base.cc:1034] running on GCE node
I20260808 07:07:34.814726 18444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:34.814960 18444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:34.816171 18444 hybrid_clock.cc:648] HybridClock initialized: now 1786172854816154 us; error 36 us; skew 500 ppm
Aug 08 07:07:34 dist-test-slave-77v9 krb5kdc[18057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172854, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:34.819041 18444 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:07:34.819535 18444 webserver.cc:460] Webserver started at http://127.9.94.3:36225/ using document root <none> and password file <none>
I20260808 07:07:34.819758 18444 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:34.819801 18444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:34.819897 18444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:34.821030 18444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "a3a76fe2d1b44d6bb7e0d85943d7bc7f"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "ccbef825bfa5d0bb8e9a3b2a161db389"
server_key_iv: "4e277e8c17c370123c309082e42cdada"
server_key_version: "encryptionkey@0"
I20260808 07:07:34.821357 18444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "a3a76fe2d1b44d6bb7e0d85943d7bc7f"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "ccbef825bfa5d0bb8e9a3b2a161db389"
server_key_iv: "4e277e8c17c370123c309082e42cdada"
server_key_version: "encryptionkey@0"
I20260808 07:07:34.822753 18444 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:07:34.823628 18459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:34.823861 18444 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:34.823969 18444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "a3a76fe2d1b44d6bb7e0d85943d7bc7f"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "ccbef825bfa5d0bb8e9a3b2a161db389"
server_key_iv: "4e277e8c17c370123c309082e42cdada"
server_key_version: "encryptionkey@0"
I20260808 07:07:34.824030 18444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:34.837663 18444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:34.840340 18444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:34.840471 18444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:34.840679 18444 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:34.841069 18444 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:34.841110 18444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:34.841133 18444 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:34.841146 18444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:34.846884 18444 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:33323
I20260808 07:07:34.847005 18575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:33323 every 8 connection(s)
I20260808 07:07:34.847316 18444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:07:34.850452 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 18444
I20260808 07:07:34.850598 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:07:34.850795 9592 external_mini_cluster.cc:1428] Setting key e694d20f958ffa91a4b011003c3799a3
Aug 08 07:07:34 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172854, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:34.858700 18144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:34.848142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:46529 (local address 127.9.94.62:39891)
0808 07:07:34.848229 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:34.848231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:34.848346 (+ 115us) server_negotiation.cc:407] Connection header received
0808 07:07:34.848920 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:34.848922 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:34.848935 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:34.849014 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:34.849974 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:34.850493 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:34.852229 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:34.852526 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:34.852585 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:34.855333 (+ 2748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:34.855334 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:34.855335 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:34.855342 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:34.856882 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:34.857451 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:34.857452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:34.857452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:34.857541 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:34.857936 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:34.857937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:34.857937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:34.858081 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:34.858155 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:34.858511 (+ 356us) server_negotiation.cc:299] Negotiation successful
0808 07:07:34.858606 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 07:07:34.858794 18578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:34.848043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:46529)
0808 07:07:34.848203 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:34.848257 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:34.848746 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:34.849072 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:34.849075 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:34.849654 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:34.849869 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:34.849874 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:34.850639 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:34.850640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:34.852118 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:34.852121 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:34.852612 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:34.852613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:34.852733 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:34.853379 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:34.853387 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:34.855210 (+ 1823us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:34.857008 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:34.857015 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:34.857018 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:34.857323 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:34.857727 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:34.857728 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:34.857728 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:34.857846 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:34.858185 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:34.858191 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:34.858343 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 07:07:34.858447 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 07:07:34.858597 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":67,"threads_started":1}
I20260808 07:07:34.859398 18576 heartbeater.cc:347] Connected to a master server at 127.9.94.62:39891
I20260808 07:07:34.859535 18576 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:34.859747 18576 heartbeater.cc:511] Master 127.9.94.62:39891 requested a full tablet report, sending...
I20260808 07:07:34.860252 18104 ts_manager.cc:194] Registered new tserver with Master: a3a76fe2d1b44d6bb7e0d85943d7bc7f (127.9.94.3:33323)
I20260808 07:07:34.860651 18104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:46529
I20260808 07:07:34.863807 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.1.keytab.
Entry for principal oryx/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.1.keytab.
WARNING: no policy specified for oryx/127.9.94.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.2.keytab.
Entry for principal oryx/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.2.keytab.
WARNING: no policy specified for oryx/127.9.94.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.3.keytab.
Entry for principal oryx/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.3.keytab.
I20260808 07:07:34.965642 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 18166
I20260808 07:07:34.972277 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 18305
I20260808 07:07:34.979283 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 18444
I20260808 07:07:34.986938 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 18070
I20260808 07:07:34.994107 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:39891
--webserver_interface=127.9.94.62
--webserver_port=40743
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:39891
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:35.082314 18585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:35.082546 18585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:35.082571 18585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:35.083707 18585 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:35.083748 18585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:35.083763 18585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:35.083776 18585 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:35.083789 18585 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:35.085314 18585 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:39891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:39891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=40743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:35.085525 18585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:35.085712 18585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:35.090943 18590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:35.091003 18591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:35.091015 18593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:35.091297 18585 server_base.cc:1034] running on GCE node
I20260808 07:07:35.091590 18585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:35.091956 18585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:35.093146 18585 hybrid_clock.cc:648] HybridClock initialized: now 1786172855093132 us; error 29 us; skew 500 ppm
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172855, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:35.096267 18585 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:07:35.096748 18585 webserver.cc:460] Webserver started at http://127.9.94.62:40743/ using document root <none> and password file <none>
I20260808 07:07:35.097152 18585 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:35.097252 18585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:35.099061 18585 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:07:35.100064 18601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:35.100329 18585 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:35.100471 18585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "22d955572a2743d28cb31c6bafed4446"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "2deb3638a43648ead71bbeaa4aabd091"
server_key_iv: "17ca258a2c8f79970b9cceba6f035bc3"
server_key_version: "encryptionkey@0"
I20260808 07:07:35.100979 18585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:35.131481 18585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:35.134003 18585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:35.134199 18585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:35.138821 18585 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:39891
I20260808 07:07:35.138864 18654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:39891 every 8 connection(s)
I20260808 07:07:35.139321 18585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:35.140962 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 18585
I20260808 07:07:35.141247 18655 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:07:35.141319 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:39709
--local_ip_for_outbound_sockets=127.9.94.1
--tserver_master_addrs=127.9.94.62:39891
--webserver_port=34395
--webserver_interface=127.9.94.1
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.94.1
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:07:35.142078 18655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446: Bootstrap starting.
I20260808 07:07:35.152146 18655 log.cc:824] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:35.154254 18655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:07:35.154609 18655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446: Bootstrap complete.
I20260808 07:07:35.157102 18655 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22d955572a2743d28cb31c6bafed4446" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39891 } }
I20260808 07:07:35.157382 18655 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22d955572a2743d28cb31c6bafed4446, State: Initialized, Role: FOLLOWER
I20260808 07:07:35.157581 18655 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22d955572a2743d28cb31c6bafed4446" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39891 } }
I20260808 07:07:35.157662 18655 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:35.157718 18655 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:35.157771 18655 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:07:35.158849 18655 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22d955572a2743d28cb31c6bafed4446" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39891 } }
I20260808 07:07:35.159238 18655 leader_election.cc:302] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22d955572a2743d28cb31c6bafed4446; no voters:
I20260808 07:07:35.159906 18655 leader_election.cc:288] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 07:07:35.159906 18659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:07:35.160135 18659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [term 2 LEADER]: Becoming Leader. State: Replica: 22d955572a2743d28cb31c6bafed4446, State: Running, Role: LEADER
I20260808 07:07:35.160248 18659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22d955572a2743d28cb31c6bafed4446" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39891 } }
I20260808 07:07:35.160305 18655 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:35.160565 18660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22d955572a2743d28cb31c6bafed4446. Latest consensus state: current_term: 2 leader_uuid: "22d955572a2743d28cb31c6bafed4446" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22d955572a2743d28cb31c6bafed4446" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39891 } } }
I20260808 07:07:35.160672 18660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:35.161036 18661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "22d955572a2743d28cb31c6bafed4446" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22d955572a2743d28cb31c6bafed4446" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 39891 } } }
I20260808 07:07:35.161104 18663 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:35.161132 18661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:35.161696 18663 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:35.161888 18663 catalog_manager.cc:1259] Loaded cluster ID: 385bb3d65a7a4c27a8da9da6e5f4efb1
I20260808 07:07:35.161952 18663 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:35.162819 18663 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:35.163046 18663 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 22d955572a2743d28cb31c6bafed4446: Loaded TSK: 0
I20260808 07:07:35.163295 18663 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:07:35.247633 18657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:35.248064 18657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:35.248116 18657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:35.249506 18657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:35.249588 18657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:35.249642 18657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:35.251296 18657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.1.keytab
--principal=oryx/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:39709
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=34395
--tserver_master_addrs=127.9.94.62:39891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:35.251608 18657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:35.251880 18657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:35.258530 18685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:35.258553 18682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:35.258503 18681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:35.258968 18657 server_base.cc:1034] running on GCE node
I20260808 07:07:35.259222 18657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:35.259511 18657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:35.260672 18657 hybrid_clock.cc:648] HybridClock initialized: now 1786172855260645 us; error 45 us; skew 500 ppm
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172855, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:35.263754 18657 init.cc:377] Logged in from keytab as oryx/127.9.94.1@KRBTEST.COM (short username oryx)
I20260808 07:07:35.264351 18657 webserver.cc:460] Webserver started at http://127.9.94.1:34395/ using document root <none> and password file <none>
I20260808 07:07:35.264622 18657 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:35.264714 18657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:35.266180 18657 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:35.266899 18693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:35.267148 18657 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:35.267298 18657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "c39a63064fbf423e80eac6651c34b9d1"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "84373d1737366fd77e5ef9284e1ba7c4"
server_key_iv: "1a520c2268c09669a6d84f02547d8b93"
server_key_version: "encryptionkey@0"
I20260808 07:07:35.267681 18657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:35.284062 18657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:35.286653 18657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:35.286867 18657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:35.287180 18657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:35.287583 18657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:35.287648 18657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:35.287693 18657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:35.287719 18657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:35.296123 18657 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:39709
I20260808 07:07:35.296219 18808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:39709 every 8 connection(s)
I20260808 07:07:35.296619 18657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:07:35.298936 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 18657
I20260808 07:07:35.299302 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:38815
--local_ip_for_outbound_sockets=127.9.94.2
--tserver_master_addrs=127.9.94.62:39891
--webserver_port=32855
--webserver_interface=127.9.94.2
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.94.2
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:35.308763 18811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:35.297549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:58579)
0808 07:07:35.297759 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:35.297815 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:35.298451 (+ 636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:35.299039 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:35.299044 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:35.299920 (+ 876us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:35.300129 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.300134 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.301923 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.301924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.303279 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.303282 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.304265 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.304266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.304427 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.305243 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:35.305254 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:35.308537 (+ 3283us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":94,"threads_started":1}
W20260808 07:07:35.309041 18809 heartbeater.cc:644] Failed to heartbeat to 127.9.94.62:39891 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.94.62:39891: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
W20260808 07:07:35.309466 18812 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:35.297623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:58579 (local address 127.9.94.62:39891)
0808 07:07:35.297864 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:35.297872 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:35.297990 (+ 118us) server_negotiation.cc:407] Connection header received
0808 07:07:35.298687 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:35.298702 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:35.298746 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:35.298901 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:35.300275 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.301785 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.303393 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.304168 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.304310 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.308772 (+ 4462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:58579: BlockingRecv error: recv got EOF from 127.9.94.1:58579 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":108,"threads_started":1}
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:35.316001 18811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:35.309258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:59813)
0808 07:07:35.309631 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:35.309643 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:35.309691 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:35.309960 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:35.309961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:35.310113 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:35.310172 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.310174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.311362 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.311363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.312203 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.312206 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.312793 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.312795 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.312953 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.313509 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:35.313515 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:35.315909 (+ 2394us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":95,"threads_started":1}
W20260808 07:07:35.316109 18812 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:35.309471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:59813 (local address 127.9.94.62:39891)
0808 07:07:35.309792 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:35.309794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:35.309805 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:35.309848 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:35.309849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:35.309865 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:35.309944 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:35.310288 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.311256 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.312314 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.312693 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.312782 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.316041 (+ 3259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:59813: BlockingRecv error: recv got EOF from 127.9.94.1:59813 (error 108)
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":95,"threads_started":1}
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:35.322989 18811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:35.316720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:35357)
0808 07:07:35.316973 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:35.316992 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:35.317065 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:35.317233 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:35.317234 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:35.317404 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:35.317446 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.317448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.318428 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.318431 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.319621 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.319626 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.320053 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.320054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.320109 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.320726 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:35.320732 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:35.322911 (+ 2179us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225}
W20260808 07:07:35.323167 18812 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:35.316840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:35357 (local address 127.9.94.62:39891)
0808 07:07:35.316877 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:35.316879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:35.317066 (+ 187us) server_negotiation.cc:407] Connection header received
0808 07:07:35.317135 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:35.317135 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:35.317147 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:35.317217 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:35.317520 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.318262 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.319732 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.319966 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.320039 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.323003 (+ 2964us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:35357: BlockingRecv error: recv got EOF from 127.9.94.1:35357 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 07:07:35.323163 18809 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:07:35.395218 18813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:35.395463 18813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:35.395490 18813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:35.396716 18813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:35.396764 18813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:35.396792 18813 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:35.398371 18813 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.2.keytab
--principal=oryx/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:38815
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=32855
--tserver_master_addrs=127.9.94.62:39891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:35.398639 18813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:35.398929 18813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:35.404285 18821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:35.404525 18813 server_base.cc:1034] running on GCE node
W20260808 07:07:35.404259 18823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:35.404259 18820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:35.404803 18813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:35.405170 18813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:35.406347 18813 hybrid_clock.cc:648] HybridClock initialized: now 1786172855406307 us; error 55 us; skew 500 ppm
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172855, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:35.409492 18813 init.cc:377] Logged in from keytab as oryx/127.9.94.2@KRBTEST.COM (short username oryx)
I20260808 07:07:35.410046 18813 webserver.cc:460] Webserver started at http://127.9.94.2:32855/ using document root <none> and password file <none>
I20260808 07:07:35.410271 18813 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:35.410342 18813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:35.411856 18813 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:35.412753 18832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:35.413113 18813 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:35.413225 18813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "2730f443dc7c419f9833dd77e3962ab5"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "01d7e5241f298634c1624a9f82d232b2"
server_key_iv: "0e9c95140c2551a60eb50947d81e8981"
server_key_version: "encryptionkey@0"
I20260808 07:07:35.413640 18813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:35.437623 18813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:35.440191 18813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:35.440398 18813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:35.440671 18813 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:35.441036 18813 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:35.441074 18813 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:35.441098 18813 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:35.441111 18813 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:35.447188 18813 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:38815
I20260808 07:07:35.447232 18948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:38815 every 8 connection(s)
I20260808 07:07:35.447603 18813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 07:07:35.455816 18812 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:35.448420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:34309 (local address 127.9.94.62:39891)
0808 07:07:35.448540 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:35.448542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:35.448732 (+ 190us) server_negotiation.cc:407] Connection header received
0808 07:07:35.449390 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:35.449391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:35.449408 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:35.449459 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:35.450437 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.450952 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.451970 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.452256 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.452397 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.455758 (+ 3361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:34309: BlockingRecv error: recv got EOF from 127.9.94.2:34309 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 07:07:35.455874 18951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:35.448372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:34309)
0808 07:07:35.448585 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:35.448633 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:35.449269 (+ 636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:35.449524 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:35.449528 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:35.450126 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:35.450335 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.450340 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.451062 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.451067 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.451873 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.451875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.452413 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.452415 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.452551 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.453319 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:35.453328 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:35.455651 (+ 2323us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":103,"threads_started":1}
W20260808 07:07:35.456283 18949 heartbeater.cc:644] Failed to heartbeat to 127.9.94.62:39891 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.94.62:39891: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
I20260808 07:07:35.457249 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 18813
I20260808 07:07:35.457630 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:33323
--local_ip_for_outbound_sockets=127.9.94.3
--tserver_master_addrs=127.9.94.62:39891
--webserver_port=36225
--webserver_interface=127.9.94.3
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.94.3
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:35.462678 18951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:35.456655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:37037)
0808 07:07:35.456702 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:35.456715 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:35.456794 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:35.457004 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:35.457005 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:35.457158 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:35.457211 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.457212 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.458085 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.458086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.458605 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.458606 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.459314 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.459316 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.459441 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.460035 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:35.460058 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:35.462572 (+ 2514us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 07:07:35.462935 18812 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:35.456734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:37037 (local address 127.9.94.62:39891)
0808 07:07:35.456835 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:35.456838 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:35.456855 (+ 17us) server_negotiation.cc:407] Connection header received
0808 07:07:35.456888 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:35.456889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:35.456901 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:35.456957 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:35.457303 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.457952 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.458704 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.459101 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.459294 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.462851 (+ 3557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:37037: BlockingRecv error: recv got EOF from 127.9.94.2:37037 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:35.468627 18951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:35.463204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:53477)
0808 07:07:35.463250 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:35.463265 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:35.463320 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:35.463480 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:35.463481 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:35.463650 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:35.463702 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.463705 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.464461 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.464462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.465425 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.465428 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.465805 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.465806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.465873 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.466369 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:35.466375 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:35.468523 (+ 2148us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 07:07:35.468727 18812 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:35.463293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:53477 (local address 127.9.94.62:39891)
0808 07:07:35.463333 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:35.463335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:35.463348 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:07:35.463387 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:35.463388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:35.463398 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:35.463457 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:35.463810 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.464346 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.465522 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.465723 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.465789 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.468639 (+ 2850us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:53477: BlockingRecv error: recv got EOF from 127.9.94.2:53477 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 07:07:35.468967 18949 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:07:35.547505 18952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:35.547781 18952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:35.547832 18952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:35.549224 18952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:35.549290 18952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:35.549340 18952 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:35.550819 18952 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/krb5kdc/oryx_127.9.94.3.keytab
--principal=oryx/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:33323
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=36225
--tserver_master_addrs=127.9.94.62:39891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:35.551100 18952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:35.551340 18952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:35.556859 18960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:35.556859 18958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:35.557020 18952 server_base.cc:1034] running on GCE node
W20260808 07:07:35.556859 18957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:35.557363 18952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:35.557636 18952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:35.558851 18952 hybrid_clock.cc:648] HybridClock initialized: now 1786172855558824 us; error 73 us; skew 500 ppm
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172855, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:35.562059 18952 init.cc:377] Logged in from keytab as oryx/127.9.94.3@KRBTEST.COM (short username oryx)
I20260808 07:07:35.562495 18952 webserver.cc:460] Webserver started at http://127.9.94.3:36225/ using document root <none> and password file <none>
I20260808 07:07:35.562773 18952 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:35.562872 18952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:35.564304 18952 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:07:35.565011 18967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:35.565191 18952 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:35.565289 18952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "a3a76fe2d1b44d6bb7e0d85943d7bc7f"
format_stamp: "Formatted at 2026-08-08 07:07:34 on dist-test-slave-77v9"
server_key: "ccbef825bfa5d0bb8e9a3b2a161db389"
server_key_iv: "4e277e8c17c370123c309082e42cdada"
server_key_version: "encryptionkey@0"
I20260808 07:07:35.565653 18952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:35.610929 18952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:35.613405 18952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:35.613582 18952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:35.613854 18952 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:35.614192 18952 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:35.614249 18952 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:35.614291 18952 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:35.614322 18952 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:35.620262 18952 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:33323
I20260808 07:07:35.620404 19084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:33323 every 8 connection(s)
I20260808 07:07:35.620752 18952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:07:35.625907 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 18952
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 07:07:35.629539 18812 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:35.621648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:51215 (local address 127.9.94.62:39891)
0808 07:07:35.621733 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:35.621737 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:35.622046 (+ 309us) server_negotiation.cc:407] Connection header received
0808 07:07:35.622533 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:35.622535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:35.622546 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:35.622604 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:35.623596 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.624131 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.625332 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.625548 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.625621 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.629473 (+ 3852us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:51215: BlockingRecv error: recv got EOF from 127.9.94.3:51215 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 07:07:35.629570 19087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:35.621597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:51215)
0808 07:07:35.621884 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:35.621922 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:35.622418 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:35.622687 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:35.622690 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:35.623290 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:35.623490 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.623495 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.624267 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.624268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.625204 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.625207 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.625648 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.625649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.625758 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.626489 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:35.626501 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:35.629328 (+ 2827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":152,"threads_started":1}
W20260808 07:07:35.629900 19085 heartbeater.cc:644] Failed to heartbeat to 127.9.94.62:39891 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.94.62:39891: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:35.635043 19087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:35.630175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:54347)
0808 07:07:35.630212 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:35.630223 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:35.630264 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:35.630460 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:35.630461 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:35.630631 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:35.630686 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.630688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.631410 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.631411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.631894 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.631895 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.632272 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.632272 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.632337 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.632793 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:35.632797 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:35.634955 (+ 2158us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":18}
W20260808 07:07:35.635118 18812 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:35.630257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:54347 (local address 127.9.94.62:39891)
0808 07:07:35.630300 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:35.630302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:35.630311 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:35.630340 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:35.630341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:35.630353 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:35.630429 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:35.630776 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.631321 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.631980 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.632187 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.632261 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.635056 (+ 2795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:54347: BlockingRecv error: recv got EOF from 127.9.94.3:54347 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:07:35.635306 18815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:35.626595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60356 (local address 127.9.94.62:39891)
0808 07:07:35.626690 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:35.626693 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:35.626716 (+ 23us) server_negotiation.cc:407] Connection header received
0808 07:07:35.626800 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:35.626801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:35.626815 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:35.626900 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:35.627640 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.628355 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.629470 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.629817 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.629901 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.631384 (+ 1483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:35.631390 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:35.631390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:35.631405 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:35.633654 (+ 2249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:35.634160 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:35.634164 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:35.634165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:35.634313 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:35.634528 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:35.634529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:35.634529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:35.634815 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:35.634921 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:35.635093 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 07:07:35.635216 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:35 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:35.640175 19087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:35.635586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:33425)
0808 07:07:35.635686 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:35.635696 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:35.635761 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:35.635970 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:35.635971 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:35.636136 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:35.636167 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.636169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.637007 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.637007 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.637535 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:35.637537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.637990 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.637991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:35.638035 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.638509 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:35.638514 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:35.640127 (+ 1613us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":18}
W20260808 07:07:35.640347 18815 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:35.635657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:33425 (local address 127.9.94.62:39891)
0808 07:07:35.635693 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:35.635695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:35.635747 (+ 52us) server_negotiation.cc:407] Connection header received
0808 07:07:35.635813 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:35.635813 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:35.635822 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:35.635873 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:35.636315 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.636932 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.637631 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:35.637859 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:35.637925 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:35.640257 (+ 2332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:33425: BlockingRecv error: recv got EOF from 127.9.94.3:33425 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 07:07:35.640352 19085 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 07:07:36 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:36 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:36.328295 19089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:36.323662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:55695)
0808 07:07:36.323826 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:36.323839 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:36.323902 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:36.324077 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:36.324077 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:36.324242 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:36.324295 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:36.324296 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:36.324995 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:36.324996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:36.325552 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:36.325554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:36.325895 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:36.325896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:36.325934 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:36.326388 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:36.326392 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:36.328218 (+ 1826us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":100,"threads_started":1}
W20260808 07:07:36.328460 19090 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:36.323787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:55695 (local address 127.9.94.62:39891)
0808 07:07:36.323925 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:36.323927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:36.323938 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:36.323968 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:36.323969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:36.323982 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:36.324061 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:36.324367 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:36.324923 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:36.325636 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:36.325825 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:36.325883 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:36.328345 (+ 2462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:55695: BlockingRecv error: recv got EOF from 127.9.94.1:55695 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
Aug 08 07:07:36 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:36 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:36.480749 19091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:36.469438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:36207)
0808 07:07:36.469585 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:36.469596 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:36.469648 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:36.469885 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:36.469886 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:36.470076 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:36.470129 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:36.470131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:36.471103 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:36.471104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:36.471741 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:36.471751 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:36.472406 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:36.472408 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:36.472463 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:36.477996 (+ 5533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:36.478002 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:36.480648 (+ 2646us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":88,"threads_started":1}
W20260808 07:07:36.480983 19090 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:36.469583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:36207 (local address 127.9.94.62:39891)
0808 07:07:36.469652 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:36.469654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:36.469664 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:07:36.469690 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:36.469691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:36.469702 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:36.469835 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:36.470267 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:36.470919 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:36.471859 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:36.472240 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:36.472379 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:36.480910 (+ 8531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:36207: BlockingRecv error: recv got EOF from 127.9.94.2:36207 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 07:07:36 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:36 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:36.646101 19092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:36.640844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:53503)
0808 07:07:36.641020 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:36.641033 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:36.641094 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:36.641236 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:36.641237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:36.641444 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:36.641497 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:36.641499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:36.642223 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:36.642224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:36.642840 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:36.642842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:36.643223 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:36.643249 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:36.643307 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:36.643783 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:36.643788 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:36.646021 (+ 2233us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":66,"threads_started":1}
W20260808 07:07:36.646286 19090 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:36.641029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:53503 (local address 127.9.94.62:39891)
0808 07:07:36.641102 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:36.641109 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:36.641118 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:36.641142 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:36.641143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:36.641156 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:36.641212 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:36.641612 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:36.642137 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:36.642926 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:36.643115 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:36.643175 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:36.646177 (+ 3002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:53503: BlockingRecv error: recv got EOF from 127.9.94.3:53503 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 07:07:37 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:37 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:37.334792 19093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:37.328998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:35545)
0808 07:07:37.329200 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:37.329215 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:37.329296 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:37.329568 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:37.329569 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:37.329746 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:37.329797 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:37.329798 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:37.330508 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:37.330509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:37.331070 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:37.331072 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:37.331712 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:37.331714 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:37.331813 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:37.332535 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:37.332540 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:37.334724 (+ 2184us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":84,"threads_started":1}
W20260808 07:07:37.335181 19095 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:37.329163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:35545 (local address 127.9.94.62:39891)
0808 07:07:37.329373 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:37.329375 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:37.329384 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:37.329410 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:37.329411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:37.329422 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:37.329490 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:37.329874 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:37.330385 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:37.331190 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:37.331403 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:37.331468 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:37.335081 (+ 3613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:35545: BlockingRecv error: recv got EOF from 127.9.94.1:35545 (error 108)
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":127,"threads_started":1}
Aug 08 07:07:37 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:37 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:37.486713 19096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:37.481372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:51323)
0808 07:07:37.481568 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:37.481582 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:37.481664 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:37.481851 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:37.481851 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:37.482047 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:37.482095 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:37.482097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:37.482782 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:37.482784 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:37.483306 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:37.483308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:37.483700 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:37.483701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:37.483766 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:37.484288 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:37.484293 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:37.486597 (+ 2304us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":98,"threads_started":1}
W20260808 07:07:37.486794 19095 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:37.481517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:51323 (local address 127.9.94.62:39891)
0808 07:07:37.481608 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:37.481610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:37.481643 (+ 33us) server_negotiation.cc:407] Connection header received
0808 07:07:37.481750 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:37.481751 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:37.481765 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:37.481844 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:37.482181 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:37.482695 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:37.483397 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:37.483609 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:37.483698 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:37.486707 (+ 3009us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:51323: BlockingRecv error: recv got EOF from 127.9.94.2:51323 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 07:07:37 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:37 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:37.651961 19097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:37.646696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:36093)
0808 07:07:37.646946 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:37.646960 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:37.647016 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:37.647205 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:37.647207 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:37.647385 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:37.647436 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:37.647437 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:37.648265 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:37.648266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:37.648996 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:37.648999 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:37.649339 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:37.649340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:37.649398 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:37.649911 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:37.649916 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:37.651897 (+ 1981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":84,"threads_started":1}
W20260808 07:07:37.652173 19095 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:37.646927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:36093 (local address 127.9.94.62:39891)
0808 07:07:37.646988 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:37.646990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:37.647023 (+ 33us) server_negotiation.cc:407] Connection header received
0808 07:07:37.647084 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:37.647085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:37.647097 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:37.647146 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:37.647509 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:37.648152 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:37.649059 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:37.649241 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:37.649300 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:37.652094 (+ 2794us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:36093: BlockingRecv error: recv got EOF from 127.9.94.3:36093 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 08 07:07:38 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:38 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:38.345336 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:38.335330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:41109)
0808 07:07:38.335534 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:38.335546 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:38.335616 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:38.335791 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:38.335792 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:38.335967 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:38.336027 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:38.336029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:38.336744 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:38.336745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:38.337373 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:38.337376 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:38.337816 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:38.337818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:38.337872 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:38.343116 (+ 5244us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:38.343121 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:38.345214 (+ 2093us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":101,"threads_started":1}
W20260808 07:07:38.345449 19099 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:38.335417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:41109 (local address 127.9.94.62:39891)
0808 07:07:38.335539 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:38.335541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:38.335608 (+ 67us) server_negotiation.cc:407] Connection header received
0808 07:07:38.335670 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:38.335671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:38.335681 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:38.335769 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:38.336110 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:38.336638 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:38.337469 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:38.337676 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:38.337793 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:38.345360 (+ 7567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:41109: BlockingRecv error: recv got EOF from 127.9.94.1:41109 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":67,"threads_started":1}
Aug 08 07:07:38 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:38 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:38.492955 19100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:38.487450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:39595)
0808 07:07:38.487630 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:38.487643 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:38.487710 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:38.487910 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:38.487911 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:38.488099 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:38.488149 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:38.488151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:38.489038 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:38.489040 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:38.489599 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:38.489601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:38.490155 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:38.490156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:38.490234 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:38.490796 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:38.490841 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:38.492882 (+ 2041us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":111,"threads_started":1}
W20260808 07:07:38.493162 19099 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:38.487648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:39595 (local address 127.9.94.62:39891)
0808 07:07:38.487754 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:38.487761 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:38.487771 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:07:38.487801 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:38.487802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:38.487813 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:38.487885 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:38.488254 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:38.488836 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:38.489700 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:38.490044 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:38.490121 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:38.493075 (+ 2954us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:39595: BlockingRecv error: recv got EOF from 127.9.94.2:39595 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 07:07:38 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:38 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:38.658001 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:38.652557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:39261)
0808 07:07:38.652718 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:38.652731 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:38.652827 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:38.653051 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:38.653052 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:38.653278 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:38.653339 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:38.653342 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:38.654081 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:38.654082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:38.655036 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:38.655040 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:38.655410 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:38.655411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:38.655455 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:38.656006 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:38.656018 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:38.657932 (+ 1914us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":104,"threads_started":1}
W20260808 07:07:38.658180 19099 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:38.652670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:39261 (local address 127.9.94.62:39891)
0808 07:07:38.652744 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:38.652746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:38.652787 (+ 41us) server_negotiation.cc:407] Connection header received
0808 07:07:38.652913 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:38.652914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:38.652928 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:38.652990 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:38.653422 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:38.653981 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:38.655133 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:38.655340 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:38.655400 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:38.658116 (+ 2716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:39261: BlockingRecv error: recv got EOF from 127.9.94.3:39261 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 07:07:39 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:39 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:39.351826 19102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:39.345982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:47055)
0808 07:07:39.346141 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:39.346160 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:39.346237 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:39.346457 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:39.346458 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:39.346646 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:39.346697 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:39.346699 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:39.347575 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:39.347576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:39.348186 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:39.348188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:39.348833 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:39.348835 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:39.348888 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:39.349562 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:39.349568 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:39.351705 (+ 2137us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":107,"threads_started":1}
W20260808 07:07:39.351950 19103 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:39.346019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:47055 (local address 127.9.94.62:39891)
0808 07:07:39.346193 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:39.346196 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:39.346206 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:07:39.346318 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:39.346319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:39.346341 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:39.346417 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:39.346816 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:39.347411 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:39.348407 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:39.348704 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:39.348771 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:39.351837 (+ 3066us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:47055: BlockingRecv error: recv got EOF from 127.9.94.1:47055 (error 108)
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":112,"threads_started":1}
Aug 08 07:07:39 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:39 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:39.499914 19104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:39.493526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:43653)
0808 07:07:39.493781 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:39.493795 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:39.493862 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:39.494162 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:39.494163 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:39.494397 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:39.494449 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:39.494451 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:39.495412 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:39.495413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:39.496049 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:39.496051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:39.496477 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:39.496478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:39.496536 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:39.497265 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:39.497270 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:39.499848 (+ 2578us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":63,"threads_started":1}
W20260808 07:07:39.500080 19103 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:39.493819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:43653 (local address 127.9.94.62:39891)
0808 07:07:39.493994 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:39.493998 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:39.494014 (+ 16us) server_negotiation.cc:407] Connection header received
0808 07:07:39.494045 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:39.494045 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:39.494056 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:39.494108 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:39.494532 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:39.495297 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:39.496175 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:39.496382 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:39.496449 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:39.499984 (+ 3535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:43653: BlockingRecv error: recv got EOF from 127.9.94.2:43653 (error 108)
Metrics: {"server-negotiator.queue_time_us":148}
Aug 08 07:07:39 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:39 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:39.664358 19105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:39.658787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:56435)
0808 07:07:39.659006 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:39.659020 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:39.659120 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:39.659289 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:39.659290 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:39.659489 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:39.659537 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:39.659538 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:39.660366 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:39.660367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:39.661010 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:39.661012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:39.661453 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:39.661454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:39.661509 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:39.662070 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:39.662076 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:39.664242 (+ 2166us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":163,"threads_started":1}
W20260808 07:07:39.664386 19103 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:39.658902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:56435 (local address 127.9.94.62:39891)
0808 07:07:39.659009 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:39.659012 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:39.659098 (+ 86us) server_negotiation.cc:407] Connection header received
0808 07:07:39.659192 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:39.659193 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:39.659207 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:39.659282 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:39.659619 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:39.660264 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:39.661102 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:39.661366 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:39.661450 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:39.664324 (+ 2874us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:56435: BlockingRecv error: recv got EOF from 127.9.94.3:56435 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 08 07:07:40 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:40 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:40.358004 19106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:40.352377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:43577)
0808 07:07:40.352618 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:40.352631 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:40.352716 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:40.352958 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:40.352959 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:40.353158 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:40.353214 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:40.353217 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:40.353948 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:40.353949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:40.354489 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:40.354491 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:40.354929 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:40.354929 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:40.354971 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:40.355537 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:40.355542 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:40.357891 (+ 2349us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":156,"threads_started":1}
W20260808 07:07:40.358075 19107 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:40.352510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:43577 (local address 127.9.94.62:39891)
0808 07:07:40.352624 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:40.352628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:40.352715 (+ 87us) server_negotiation.cc:407] Connection header received
0808 07:07:40.352782 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:40.352783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:40.352793 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:40.352901 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:40.353304 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:40.353824 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:40.354597 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:40.354819 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:40.354890 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:40.357992 (+ 3102us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:43577: BlockingRecv error: recv got EOF from 127.9.94.1:43577 (error 108)
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":58,"threads_started":1}
Aug 08 07:07:40 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:40 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:40.505620 19108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:40.500486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:32923)
0808 07:07:40.500677 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:40.500689 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:40.500742 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:40.500940 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:40.500941 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:40.501113 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:40.501164 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:40.501166 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:40.501825 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:40.501826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:40.502368 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:40.502370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:40.502824 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:40.502825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:40.502875 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:40.503409 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:40.503414 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:40.505508 (+ 2094us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":124,"threads_started":1}
W20260808 07:07:40.505664 19107 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:40.500662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:32923 (local address 127.9.94.62:39891)
0808 07:07:40.500731 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:40.500733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:40.500750 (+ 17us) server_negotiation.cc:407] Connection header received
0808 07:07:40.500843 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:40.500844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:40.500855 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:40.500905 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:40.501254 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:40.501754 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:40.502464 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:40.502685 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:40.502805 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:40.505597 (+ 2792us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:32923: BlockingRecv error: recv got EOF from 127.9.94.2:32923 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 08 07:07:40 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:40 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:40.671716 19109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:40.665036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:58357)
0808 07:07:40.665175 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:40.665187 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:40.665257 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:40.665437 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:40.665438 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:40.665625 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:40.665678 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:40.665680 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:40.666787 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:40.666789 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:40.667571 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:40.667574 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:40.668257 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:40.668258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:40.668340 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:40.669020 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:40.669027 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:40.671593 (+ 2566us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":89,"threads_started":1}
W20260808 07:07:40.671828 19107 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:40.665104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:58357 (local address 127.9.94.62:39891)
0808 07:07:40.665167 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:40.665170 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:40.665264 (+ 94us) server_negotiation.cc:407] Connection header received
0808 07:07:40.665310 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:40.665311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:40.665328 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:40.665408 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:40.665750 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:40.666692 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:40.667651 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:40.668054 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:40.668135 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:40.671716 (+ 3581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:58357: BlockingRecv error: recv got EOF from 127.9.94.3:58357 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 08 07:07:41 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:41 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:41.365008 19110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:41.358655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:36907)
0808 07:07:41.358828 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:41.358849 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:41.358921 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:41.359083 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:41.359084 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:41.359259 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:41.359311 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:41.359313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:41.360137 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:41.360138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:41.360892 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:41.360895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:41.361380 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:41.361382 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:41.361476 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:41.362262 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:41.362269 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:41.364922 (+ 2653us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":106,"threads_started":1}
W20260808 07:07:41.365077 19111 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:41.358777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:36907 (local address 127.9.94.62:39891)
0808 07:07:41.358889 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:41.358892 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:41.358904 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:07:41.358997 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:41.358998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:41.359009 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:41.359062 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:41.359415 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:41.360027 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:41.361000 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:41.361228 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:41.361295 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:41.365018 (+ 3723us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:36907: BlockingRecv error: recv got EOF from 127.9.94.1:36907 (error 108)
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":56,"threads_started":1}
Aug 08 07:07:41 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:41 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:41.511910 19112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:41.506241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:50849)
0808 07:07:41.506421 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:41.506430 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:41.506513 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:41.506755 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:41.506757 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:41.506941 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:41.506995 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:41.506997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:41.507781 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:41.507782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:41.508370 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:41.508372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:41.508846 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:41.508847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:41.508991 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:41.509523 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:41.509528 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:41.511833 (+ 2305us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":94,"threads_started":1}
W20260808 07:07:41.512112 19111 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:41.506321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:50849 (local address 127.9.94.62:39891)
0808 07:07:41.506412 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:41.506414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:41.506514 (+ 100us) server_negotiation.cc:407] Connection header received
0808 07:07:41.506568 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:41.506569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:41.506580 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:41.506649 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:41.507106 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:41.507669 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:41.508492 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:41.508725 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:41.508795 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:41.512038 (+ 3243us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:50849: BlockingRecv error: recv got EOF from 127.9.94.2:50849 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 07:07:41 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:41 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:41.677762 19113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:41.672352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:36887)
0808 07:07:41.672526 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:41.672551 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:41.672618 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:41.672828 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:41.672829 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:41.673030 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:41.673097 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:41.673099 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:41.673789 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:41.673790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:41.674328 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:41.674330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:41.674771 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:41.674772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:41.674819 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:41.675402 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:41.675407 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:41.677693 (+ 2286us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":122,"threads_started":1}
W20260808 07:07:41.677958 19111 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:41.672455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:36887 (local address 127.9.94.62:39891)
0808 07:07:41.672525 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:41.672527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:41.672662 (+ 135us) server_negotiation.cc:407] Connection header received
0808 07:07:41.672688 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:41.672689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:41.672701 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:41.672747 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:41.673199 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:41.673708 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:41.674449 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:41.674651 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:41.674736 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:41.677840 (+ 3104us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:36887: BlockingRecv error: recv got EOF from 127.9.94.3:36887 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 08 07:07:42 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:42 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:42.371191 19114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:42.365561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:39791)
0808 07:07:42.365710 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:42.365731 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:42.365788 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:42.366029 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:42.366030 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:42.366200 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:42.366251 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:42.366253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:42.367078 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:42.367079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:42.367699 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:42.367702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:42.368115 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:42.368116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:42.368164 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:42.368832 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:42.368836 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:42.371075 (+ 2239us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":101,"threads_started":1}
W20260808 07:07:42.371274 19115 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:42.365668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:39791 (local address 127.9.94.62:39891)
0808 07:07:42.365867 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:42.365869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:42.365880 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:42.365906 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:42.365906 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:42.365918 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:42.365994 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:42.366365 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:42.366972 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:42.367808 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:42.368029 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:42.368093 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:42.371165 (+ 3072us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:39791: BlockingRecv error: recv got EOF from 127.9.94.1:39791 (error 108)
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":107,"threads_started":1}
Aug 08 07:07:42 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:42 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:42.518173 19116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:42.512564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:40601)
0808 07:07:42.512708 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:42.512724 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:42.512792 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:42.513008 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:42.513009 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:42.513182 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:42.513233 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:42.513234 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:42.514035 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:42.514036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:42.514585 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:42.514586 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:42.515031 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:42.515033 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:42.515082 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:42.515612 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:42.515616 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:42.518065 (+ 2449us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":74,"threads_started":1}
W20260808 07:07:42.518230 19115 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:42.512645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:40601 (local address 127.9.94.62:39891)
0808 07:07:42.512743 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:42.512745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:42.512772 (+ 27us) server_negotiation.cc:407] Connection header received
0808 07:07:42.512916 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:42.512917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:42.512936 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:42.512986 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:42.513334 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:42.513926 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:42.514697 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:42.514936 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:42.515011 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:42.518162 (+ 3151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:40601: BlockingRecv error: recv got EOF from 127.9.94.2:40601 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 07:07:42 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:42 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:42.684134 19117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:42.678448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:53063)
0808 07:07:42.678645 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:42.678667 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:42.678755 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:42.678986 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:42.678987 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:42.679166 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:42.679252 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:42.679255 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:42.679990 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:42.679991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:42.680615 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:42.680616 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:42.681264 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:42.681266 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:42.681338 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:42.682067 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:42.682072 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:42.684072 (+ 2000us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":107,"threads_started":1}
W20260808 07:07:42.684311 19115 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:42.678601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:53063 (local address 127.9.94.62:39891)
0808 07:07:42.678697 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:42.678699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:42.678749 (+ 50us) server_negotiation.cc:407] Connection header received
0808 07:07:42.678819 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:42.678820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:42.678878 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:42.678938 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:42.679327 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:42.679874 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:42.680692 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:42.681008 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:42.681084 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:42.684199 (+ 3115us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:53063: BlockingRecv error: recv got EOF from 127.9.94.3:53063 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 07:07:43 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:43 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:43.382587 19118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:43.372063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:40895)
0808 07:07:43.372328 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:43.372346 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:43.372435 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:43.372761 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:43.372762 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:43.373058 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:43.373132 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:43.373135 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:43.374234 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:43.374235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:43.375016 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:43.375019 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:43.375497 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:43.375498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:43.375550 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:43.380042 (+ 4492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:43.380048 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:43.382517 (+ 2469us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":175,"threads_started":1}
W20260808 07:07:43.382786 19119 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:43.372294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:40895 (local address 127.9.94.62:39891)
0808 07:07:43.372484 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:43.372491 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:43.372502 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:43.372533 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:43.372533 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:43.372553 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:43.372640 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:43.373348 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:43.374123 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:43.375169 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:43.375393 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:43.375457 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:43.382670 (+ 7213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:40895: BlockingRecv error: recv got EOF from 127.9.94.1:40895 (error 108)
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":85,"threads_started":1}
Aug 08 07:07:43 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:43 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:43.525609 19120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:43.518847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:40763)
0808 07:07:43.519072 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:43.519085 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:43.519182 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:43.519739 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:43.519740 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:43.519972 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:43.520023 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:43.520025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:43.521159 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:43.521160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:43.522273 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:43.522276 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:43.522721 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:43.522722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:43.522802 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:43.523376 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:43.523380 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:43.525531 (+ 2151us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":125,"threads_started":1}
W20260808 07:07:43.525846 19119 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:43.518943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:40763 (local address 127.9.94.62:39891)
0808 07:07:43.519043 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:43.519045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:43.519187 (+ 142us) server_negotiation.cc:407] Connection header received
0808 07:07:43.519260 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:43.519261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:43.519274 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:43.519455 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:43.520130 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:43.521091 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:43.522388 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:43.522602 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:43.522669 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:43.525660 (+ 2991us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:40763: BlockingRecv error: recv got EOF from 127.9.94.2:40763 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 07:07:43 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:43 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:43.690316 19121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:43.684742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:43081)
0808 07:07:43.684987 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:43.685006 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:43.685078 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:43.685228 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:43.685229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:43.685399 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:43.685453 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:43.685454 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:43.686335 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:43.686336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:43.686911 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:43.686914 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:43.687326 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:43.687327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:43.687374 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:43.687984 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:43.687989 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:43.690227 (+ 2238us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":147,"threads_started":1}
W20260808 07:07:43.690411 19119 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:43.684896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:43081 (local address 127.9.94.62:39891)
0808 07:07:43.684952 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:43.684954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:43.685102 (+ 148us) server_negotiation.cc:407] Connection header received
0808 07:07:43.685129 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:43.685130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:43.685143 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:43.685205 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:43.685557 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:43.686201 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:43.687021 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:43.687230 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:43.687307 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:43.690318 (+ 3011us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:43081: BlockingRecv error: recv got EOF from 127.9.94.3:43081 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 08 07:07:44 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:44 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:44.388301 19122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:44.383167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:36979)
0808 07:07:44.383368 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:44.383380 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:44.383443 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:44.383595 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:44.383595 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:44.383804 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:44.383865 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:44.383867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:44.384548 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:44.384549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:44.385150 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:44.385152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:44.385613 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:44.385614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:44.385662 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:44.386192 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:44.386197 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:44.388234 (+ 2037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":107,"threads_started":1}
W20260808 07:07:44.388417 19123 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:44.383302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:36979 (local address 127.9.94.62:39891)
0808 07:07:44.383458 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:44.383459 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:44.383468 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:44.383491 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:44.383491 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:44.383501 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:44.383580 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:44.383945 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:44.384453 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:44.385277 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:44.385509 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:44.385591 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:44.388338 (+ 2747us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:36979: BlockingRecv error: recv got EOF from 127.9.94.1:36979 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":102,"threads_started":1}
Aug 08 07:07:44 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:44 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:44.532044 19124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:44.526333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:32789)
0808 07:07:44.526599 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:44.526613 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:44.526687 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:44.526858 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:44.526859 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:44.527073 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:44.527307 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:44.527311 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:44.528103 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:44.528104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:44.528693 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:44.528695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:44.529151 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:44.529152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:44.529223 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:44.529783 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:44.529788 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:44.531932 (+ 2144us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":154,"threads_started":1}
W20260808 07:07:44.532109 19123 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:44.526502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:32789 (local address 127.9.94.62:39891)
0808 07:07:44.526584 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:44.526587 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:44.526666 (+ 79us) server_negotiation.cc:407] Connection header received
0808 07:07:44.526747 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:44.526748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:44.526762 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:44.526854 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:44.527431 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:44.528009 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:44.528792 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:44.529065 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:44.529154 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:44.532034 (+ 2880us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:32789: BlockingRecv error: recv got EOF from 127.9.94.2:32789 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 07:07:44 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:44 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:44.696883 19125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:44.691080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:38821)
0808 07:07:44.691239 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:44.691262 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:44.691316 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:44.691587 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:44.691588 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:44.691776 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:44.691829 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:44.691830 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:44.692657 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:44.692658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:44.693523 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:44.693526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:44.693964 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:44.693965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:44.694013 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:44.694620 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:44.694625 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:44.696750 (+ 2125us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":103,"threads_started":1}
W20260808 07:07:44.697070 19123 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:44.691257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:38821 (local address 127.9.94.62:39891)
0808 07:07:44.691436 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:44.691438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:44.691447 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:44.691472 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:44.691473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:44.691485 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:44.691541 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:44.691948 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:44.692530 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:44.693658 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:44.693852 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:44.693935 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:44.696998 (+ 3063us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:38821: BlockingRecv error: recv got EOF from 127.9.94.3:38821 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 07:07:45 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:45 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:45.395562 19127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:45.389083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:58649)
0808 07:07:45.389253 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:45.389296 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:45.389369 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:45.389843 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:45.389845 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:45.390107 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:45.390176 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:45.390178 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:45.391304 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:45.391305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:45.391947 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:45.391950 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:45.392393 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:45.392394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:45.392443 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:45.393208 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:45.393213 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:45.395456 (+ 2243us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":76,"threads_started":1}
W20260808 07:07:45.395641 19128 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:45.389136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:58649 (local address 127.9.94.62:39891)
0808 07:07:45.389265 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:45.389268 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:45.389353 (+ 85us) server_negotiation.cc:407] Connection header received
0808 07:07:45.389634 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:45.389636 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:45.389652 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:45.389739 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:45.390275 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:45.391116 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:45.392065 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:45.392294 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:45.392390 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:45.395563 (+ 3173us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:58649: BlockingRecv error: recv got EOF from 127.9.94.1:58649 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":51,"threads_started":1}
Aug 08 07:07:45 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:45 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:45.539155 19129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:45.533088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:54821)
0808 07:07:45.533242 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:45.533253 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:45.533341 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:45.533642 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:45.533643 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:45.533853 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:45.533943 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:45.533946 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:45.534833 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:45.534834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:45.535385 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:45.535387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:45.535804 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:45.535805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:45.535861 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:45.536441 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:45.536446 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:45.539046 (+ 2600us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":65,"threads_started":1}
W20260808 07:07:45.539516 19128 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:45.533243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:54821 (local address 127.9.94.62:39891)
0808 07:07:45.533341 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:45.533344 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:45.533355 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:45.533447 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:45.533448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:45.533461 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:45.533627 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:45.534056 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:45.534722 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:45.535481 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:45.535711 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:45.535817 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:45.539424 (+ 3607us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:54821: BlockingRecv error: recv got EOF from 127.9.94.2:54821 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 08 07:07:45 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:45 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:45.702539 19130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:45.697541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:41483)
0808 07:07:45.697718 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:45.697730 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:45.697821 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:45.698029 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:45.698030 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:45.698227 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:45.698274 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:45.698276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:45.698974 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:45.698975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:45.699512 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:45.699514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:45.699921 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:45.699922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:45.699990 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:45.700525 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:45.700530 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:45.702466 (+ 1936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":110,"threads_started":1}
W20260808 07:07:45.702735 19128 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:45.697739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:41483 (local address 127.9.94.62:39891)
0808 07:07:45.697822 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:45.697824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:45.697836 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:07:45.697901 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:45.697902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:45.697918 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:45.698017 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:45.698358 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:45.698880 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:45.699602 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:45.699797 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:45.699917 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:45.702642 (+ 2725us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:41483: BlockingRecv error: recv got EOF from 127.9.94.3:41483 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 07:07:46 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:46 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:46.402666 19131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:46.396360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:40561)
0808 07:07:46.396573 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:46.396593 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:46.396652 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:46.396984 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:46.396985 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:46.397159 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:46.397210 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:46.397212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:46.397999 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:46.398000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:46.398750 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:46.398752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:46.399173 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:46.399174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:46.399221 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:46.399842 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:46.399847 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:46.402571 (+ 2724us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":70,"threads_started":1}
W20260808 07:07:46.402850 19132 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:46.396595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:40561 (local address 127.9.94.62:39891)
0808 07:07:46.396842 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:46.396844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:46.396855 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:46.396885 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:46.396886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:46.396902 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:46.396963 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:46.397345 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:46.397882 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:46.398862 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:46.399074 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:46.399136 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:46.402723 (+ 3587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:40561: BlockingRecv error: recv got EOF from 127.9.94.1:40561 (error 108)
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":167,"threads_started":1}
Aug 08 07:07:46 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:46 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:46.547027 19133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:46.540082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:49467)
0808 07:07:46.540359 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:46.540372 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:46.540457 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:46.540771 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:46.540773 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:46.541270 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:46.541349 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:46.541353 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:46.542163 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:46.542164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:46.542739 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:46.542742 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:46.543335 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:46.543337 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:46.543412 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:46.544257 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:46.544262 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:46.546949 (+ 2687us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":182,"threads_started":1}
W20260808 07:07:46.547405 19132 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:46.540246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:49467 (local address 127.9.94.62:39891)
0808 07:07:46.540334 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:46.540336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:46.540498 (+ 162us) server_negotiation.cc:407] Connection header received
0808 07:07:46.540547 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:46.540548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:46.540573 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:46.540678 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:46.541506 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:46.542032 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:46.542916 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:46.543188 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:46.543294 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:46.547300 (+ 4006us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:49467: BlockingRecv error: recv got EOF from 127.9.94.2:49467 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 07:07:46 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:46 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 07:07:46.709607 19132 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:46.703331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:53837 (local address 127.9.94.62:39891)
0808 07:07:46.703451 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:46.703453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:46.703469 (+ 16us) server_negotiation.cc:407] Connection header received
0808 07:07:46.703531 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:46.703532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:46.703545 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:46.703616 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:46.704128 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:46.704854 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:46.705791 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:46.706035 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:46.706104 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:46.709543 (+ 3439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:53837: BlockingRecv error: recv got EOF from 127.9.94.3:53837 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 07:07:46.709439 19134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:46.703207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:53837)
0808 07:07:46.703379 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:46.703392 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:46.703459 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:46.703672 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:46.703673 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:46.703973 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:46.704027 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:46.704029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:46.705107 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:46.705108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:46.705667 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:46.705670 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:46.706137 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:46.706139 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:46.706206 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:46.706802 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:46.706807 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:46.709340 (+ 2533us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":121,"threads_started":1}
Aug 08 07:07:47 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:47 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:47.411083 19135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:47.403390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:59597)
0808 07:07:47.403580 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:47.403599 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:47.403656 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:47.403911 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:47.403912 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:47.404098 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:47.404152 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:47.404153 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:47.405463 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:47.405464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:47.406062 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:47.406064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:47.406615 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:47.406618 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:47.406703 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:47.407629 (+ 926us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:47.407642 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:47.410953 (+ 3311us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":135,"threads_started":1}
W20260808 07:07:47.411340 19136 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:47.403555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:59597 (local address 127.9.94.62:39891)
0808 07:07:47.403708 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:47.403710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:47.403723 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:07:47.403761 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:47.403762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:47.403780 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:47.403886 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:47.404292 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:47.405340 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:47.406181 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:47.406408 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:47.406512 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:47.411161 (+ 4649us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:59597: BlockingRecv error: recv got EOF from 127.9.94.1:59597 (error 108)
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":88,"threads_started":1}
Aug 08 07:07:47 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:47 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:47.554792 19137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:47.548017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:42353)
0808 07:07:47.548331 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:47.548346 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:47.548429 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:47.548694 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:47.548696 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:47.548994 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:47.549065 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:47.549067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:47.550111 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:47.550112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:47.550702 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:47.550703 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:47.551277 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:47.551279 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:47.551356 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:47.551943 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:47.551947 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:47.554683 (+ 2736us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":257,"threads_started":1}
W20260808 07:07:47.555037 19136 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:47.547964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:42353 (local address 127.9.94.62:39891)
0808 07:07:47.548015 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:47.548018 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:47.548543 (+ 525us) server_negotiation.cc:407] Connection header received
0808 07:07:47.548571 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:47.548572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:47.548584 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:47.548636 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:47.549166 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:47.550022 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:47.550863 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:47.551132 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:47.551243 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:47.554960 (+ 3717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:42353: BlockingRecv error: recv got EOF from 127.9.94.2:42353 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 08 07:07:47 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:47 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:47.716395 19138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:47.710315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:56955)
0808 07:07:47.710499 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:47.710512 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:47.710578 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:47.710728 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:47.710729 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:47.710968 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:47.711022 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:47.711024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:47.711994 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:47.711995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:47.712558 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:47.712560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:47.713165 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:47.713167 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:47.713222 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:47.714028 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:47.714035 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:47.716246 (+ 2211us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":67,"threads_started":1}
W20260808 07:07:47.716497 19136 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:47.710501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:56955 (local address 127.9.94.62:39891)
0808 07:07:47.710566 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:47.710568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:47.710585 (+ 17us) server_negotiation.cc:407] Connection header received
0808 07:07:47.710631 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:47.710631 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:47.710643 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:47.710698 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:47.711202 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:47.711829 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:47.712699 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:47.713053 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:47.713142 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:47.716401 (+ 3259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:56955: BlockingRecv error: recv got EOF from 127.9.94.3:56955 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 07:07:48 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:48 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:48.423424 19139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:48.411708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:43235)
0808 07:07:48.411897 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:48.411910 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:48.411974 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:48.412223 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:48.412225 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:48.412409 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:48.412463 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:48.412464 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:48.413251 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:48.413276 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:48.413906 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:48.413909 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:48.414474 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:48.414475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:48.414525 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:48.420955 (+ 6430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:48.420963 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:48.423301 (+ 2338us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
W20260808 07:07:48.423497 19140 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:48.411914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:43235 (local address 127.9.94.62:39891)
0808 07:07:48.412064 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:48.412066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:48.412074 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:07:48.412097 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:48.412098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:48.412108 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:48.412177 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:48.412545 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:48.413163 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:48.414056 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:48.414344 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:48.414422 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:48.423418 (+ 8996us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:43235: BlockingRecv error: recv got EOF from 127.9.94.1:43235 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":86,"threads_started":1}
Aug 08 07:07:48 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:48 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:48.561630 19141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:48.555439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:57637)
0808 07:07:48.555628 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:48.555640 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:48.555719 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:48.555974 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:48.555975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:48.556166 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:48.556222 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:48.556223 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:48.557205 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:48.557206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:48.557959 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:48.557963 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:48.558433 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:48.558434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:48.558487 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:48.559061 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:48.559067 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:48.561503 (+ 2436us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":71,"threads_started":1}
W20260808 07:07:48.561810 19140 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:48.555665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:57637 (local address 127.9.94.62:39891)
0808 07:07:48.555741 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:48.555744 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:48.555752 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:07:48.555782 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:48.555784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:48.555798 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:48.555960 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:48.556311 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:48.557094 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:48.558091 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:48.558334 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:48.558407 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:48.561676 (+ 3269us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:57637: BlockingRecv error: recv got EOF from 127.9.94.2:57637 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 07:07:48 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:48 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:48.723592 19142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:48.717436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:40841)
0808 07:07:48.717727 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:48.717743 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:48.717850 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:48.718237 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:48.718239 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:48.718438 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:48.718505 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:48.718506 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:48.719301 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:48.719303 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:48.720140 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:48.720146 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:48.720549 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:48.720550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:48.720601 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:48.721232 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:48.721236 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:48.723512 (+ 2276us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":124,"threads_started":1}
W20260808 07:07:48.723757 19140 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:48.717841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:40841 (local address 127.9.94.62:39891)
0808 07:07:48.717948 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:48.717951 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:48.717976 (+ 25us) server_negotiation.cc:407] Connection header received
0808 07:07:48.718029 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:48.718031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:48.718050 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:48.718137 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:48.718613 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:48.719131 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:48.720242 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:48.720457 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:48.720520 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:48.723648 (+ 3128us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:40841: BlockingRecv error: recv got EOF from 127.9.94.3:40841 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 08 07:07:49 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:49 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:49.430378 19143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:49.424073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:57843)
0808 07:07:49.424253 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:49.424266 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:49.424338 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:49.424542 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:49.424544 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:49.424731 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:49.424783 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:49.424785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:49.425564 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:49.425566 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:49.426187 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:49.426189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:49.426725 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:49.426726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:49.426794 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:49.427514 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:49.427520 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:49.430220 (+ 2700us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":114,"threads_started":1}
W20260808 07:07:49.430457 19144 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:49.424168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:57843 (local address 127.9.94.62:39891)
0808 07:07:49.424333 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:49.424335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:49.424347 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:07:49.424392 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:49.424393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:49.424403 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:49.424477 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:49.424934 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:49.425471 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:49.426297 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:49.426614 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:49.426699 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:49.430364 (+ 3665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:57843: BlockingRecv error: recv got EOF from 127.9.94.1:57843 (error 108)
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":96,"threads_started":1}
Aug 08 07:07:49 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:49 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:49.567574 19145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:49.562337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:35515)
0808 07:07:49.562535 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:49.562549 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:49.562653 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:49.562872 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:49.562873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:49.563127 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:49.563196 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:49.563198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:49.564075 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:49.564076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:49.564616 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:49.564617 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:49.565075 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:49.565076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:49.565131 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:49.565628 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:49.565633 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:49.567511 (+ 1878us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":93,"threads_started":1}
W20260808 07:07:49.567863 19144 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:49.562446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:35515 (local address 127.9.94.62:39891)
0808 07:07:49.562539 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:49.562542 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:49.562632 (+ 90us) server_negotiation.cc:407] Connection header received
0808 07:07:49.562744 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:49.562745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:49.562758 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:49.562846 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:49.563264 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:49.563992 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:49.564706 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:49.564988 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:49.565074 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:49.567787 (+ 2713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:35515: BlockingRecv error: recv got EOF from 127.9.94.2:35515 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 07:07:49 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:49 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.3@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:49.729704 19146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:49.724237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.3:37645)
0808 07:07:49.724455 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:49.724468 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:49.724544 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:49.724708 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:49.724709 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:49.724985 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:49.725033 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:49.725035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:49.725747 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:49.725748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:49.726328 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:49.726330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:49.726704 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:49.726705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:49.726883 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:49.727414 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:49.727418 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:49.729616 (+ 2198us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":125,"threads_started":1}
W20260808 07:07:49.729833 19144 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:49.724374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:37645 (local address 127.9.94.62:39891)
0808 07:07:49.724453 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:49.724455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:49.724522 (+ 67us) server_negotiation.cc:407] Connection header received
0808 07:07:49.724610 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:49.724613 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:49.724631 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:49.724686 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:49.725123 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:49.725650 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:49.726417 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:49.726615 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:49.726693 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:49.729724 (+ 3031us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.3:37645: BlockingRecv error: recv got EOF from 127.9.94.3:37645 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 07:07:50 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:50 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.1@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:07:50.437803 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:50.430864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.1:33957)
0808 07:07:50.430992 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:50.431004 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:50.431087 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:50.431411 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:50.431413 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:50.431643 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:50.431712 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:50.431715 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:50.432796 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:50.432797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:50.433849 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:50.433857 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:50.434444 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:50.434447 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:50.434525 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:50.435080 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:50.435085 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:50.437715 (+ 2630us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":78,"threads_started":1}
W20260808 07:07:50.438009 19149 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:50.431050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:33957 (local address 127.9.94.62:39891)
0808 07:07:50.431239 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:50.431243 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:50.431255 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:07:50.431286 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:50.431287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:50.431303 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:50.431390 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:50.431810 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:50.432696 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:50.433952 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:50.434345 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:50.434426 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:50.437916 (+ 3490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.1:33957: BlockingRecv error: recv got EOF from 127.9.94.1:33957 (error 108)
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":77,"threads_started":1}
Aug 08 07:07:50 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:07:50 dist-test-slave-77v9 krb5kdc[18057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.94.2@KRBTEST.COM for oryx/127.9.94.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 07:07:50.574904 19149 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:50.569053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:59017 (local address 127.9.94.62:39891)
0808 07:07:50.569151 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:50.569154 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:50.569301 (+ 147us) server_negotiation.cc:407] Connection header received
0808 07:07:50.569418 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:50.569419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:50.569431 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:50.569506 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:50.569855 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:50.570496 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:50.571279 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:50.571524 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:50.571602 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:50.574835 (+ 3233us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.94.2:59017: BlockingRecv error: recv got EOF from 127.9.94.2:59017 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 07:07:50.574905 19150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:50.568987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:39891 (local address 127.9.94.2:59017)
0808 07:07:50.569215 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:50.569226 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:50.569323 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:50.569520 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:50.569521 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:50.569719 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:50.569767 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:50.569769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:50.570584 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:50.570585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:50.571170 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:50.571171 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:50.571682 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:50.571684 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:50.571741 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:50.572360 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:50.572365 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:50.574734 (+ 2369us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.94.62:39891: Server oryx/127.9.94.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":126,"threads_started":1}
I20260808 07:07:50.630134 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 18657
I20260808 07:07:50.635833 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 18813
I20260808 07:07:50.642571 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 18952
I20260808 07:07:50.648173 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 18585
2026-08-08T07:07:50Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17764 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T07:07:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:50Z Disabled control of system clock
I20260808 07:07:50.681093 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36035
--webserver_interface=127.9.94.62
--webserver_port=0
--builtin_ntp_servers=127.9.94.20:41493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:36035
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 07:07:50.772054 19154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:50.772289 19154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:50.772308 19154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:50.773638 19154 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:50.773691 19154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:50.773705 19154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:50.773717 19154 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:50.773730 19154 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:50.775090 19154 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:36035
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:50.775321 19154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:50.775595 19154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:50.782708 19162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:50.782905 19160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:50.782804 19154 server_base.cc:1034] running on GCE node
W20260808 07:07:50.782917 19159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:50.783420 19154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:50.783793 19154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:50.785125 19154 hybrid_clock.cc:648] HybridClock initialized: now 1786172870785100 us; error 61 us; skew 500 ppm
I20260808 07:07:50.786700 19154 webserver.cc:460] Webserver started at http://127.9.94.62:37303/ using document root <none> and password file <none>
I20260808 07:07:50.787050 19154 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:50.787132 19154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:50.787298 19154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:50.788466 19154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "d04657f8933048989df59c067e8c5baf"
format_stamp: "Formatted at 2026-08-08 07:07:50 on dist-test-slave-77v9"
server_key: "4a9e28e2a943d1f8fa0b2c6d86cac6d9"
server_key_iv: "e815d363845a516e3aba28dc825390ef"
server_key_version: "encryptionkey@0"
I20260808 07:07:50.788921 19154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "d04657f8933048989df59c067e8c5baf"
format_stamp: "Formatted at 2026-08-08 07:07:50 on dist-test-slave-77v9"
server_key: "4a9e28e2a943d1f8fa0b2c6d86cac6d9"
server_key_iv: "e815d363845a516e3aba28dc825390ef"
server_key_version: "encryptionkey@0"
I20260808 07:07:50.790350 19154 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:50.791237 19168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:50.791527 19154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:50.791656 19154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "d04657f8933048989df59c067e8c5baf"
format_stamp: "Formatted at 2026-08-08 07:07:50 on dist-test-slave-77v9"
server_key: "4a9e28e2a943d1f8fa0b2c6d86cac6d9"
server_key_iv: "e815d363845a516e3aba28dc825390ef"
server_key_version: "encryptionkey@0"
I20260808 07:07:50.791800 19154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:50.802851 19154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:50.803218 19154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:50.803382 19154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:50.807758 19154 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:36035
I20260808 07:07:50.807929 19224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:36035 every 8 connection(s)
I20260808 07:07:50.808218 19154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:50.809087 19225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:50.812006 19225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf: Bootstrap starting.
I20260808 07:07:50.812678 19225 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:50.813068 19225 log.cc:824] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:50.813854 19225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf: No bootstrap required, opened a new log
I20260808 07:07:50.815685 19225 raft_consensus.cc:348] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d04657f8933048989df59c067e8c5baf" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36035 } }
I20260808 07:07:50.815845 19225 raft_consensus.cc:374] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:50.815871 19225 raft_consensus.cc:729] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04657f8933048989df59c067e8c5baf, State: Initialized, Role: FOLLOWER
I20260808 07:07:50.816071 19225 consensus_queue.cc:260] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d04657f8933048989df59c067e8c5baf" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36035 } }
I20260808 07:07:50.816154 19225 raft_consensus.cc:388] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:50.816179 19225 raft_consensus.cc:482] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:50.816250 19225 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:50.816942 19225 raft_consensus.cc:504] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d04657f8933048989df59c067e8c5baf" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36035 } }
I20260808 07:07:50.817067 19225 leader_election.cc:302] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d04657f8933048989df59c067e8c5baf; no voters:
I20260808 07:07:50.817304 19225 leader_election.cc:288] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:50.817345 19228 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:50.817557 19228 raft_consensus.cc:686] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [term 1 LEADER]: Becoming Leader. State: Replica: d04657f8933048989df59c067e8c5baf, State: Running, Role: LEADER
I20260808 07:07:50.817608 19225 sys_catalog.cc:564] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:50.817770 19228 consensus_queue.cc:237] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d04657f8933048989df59c067e8c5baf" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36035 } }
I20260808 07:07:50.818148 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 19154
I20260808 07:07:50.818271 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:50.818547 9592 external_mini_cluster.cc:1428] Setting key 60b402c88369fbd2d0210647ace0ecf3
I20260808 07:07:50.819093 19230 sys_catalog.cc:455] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [sys.catalog]: SysCatalogTable state changed. Reason: New leader d04657f8933048989df59c067e8c5baf. Latest consensus state: current_term: 1 leader_uuid: "d04657f8933048989df59c067e8c5baf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d04657f8933048989df59c067e8c5baf" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36035 } } }
I20260808 07:07:50.819182 19230 sys_catalog.cc:458] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:50.819448 19229 sys_catalog.cc:455] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d04657f8933048989df59c067e8c5baf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d04657f8933048989df59c067e8c5baf" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36035 } } }
I20260808 07:07:50.819609 19229 sys_catalog.cc:458] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:50.819692 19244 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:50.820287 19244 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:50.822201 19244 catalog_manager.cc:1347] Generated new cluster ID: 23ce6ded11c049e69c3e23201b677186
I20260808 07:07:50.822263 19244 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:50.825668 19245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:50.819232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41142 (local address 127.9.94.62:36035)
0808 07:07:50.819527 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:50.819539 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:50.819580 (+ 41us) server_negotiation.cc:407] Connection header received
0808 07:07:50.819706 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:50.819714 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:50.819795 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:50.819953 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:50.820250 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:50.821624 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:50.822834 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:50.823516 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:50.823813 (+ 297us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:50.824853 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:50.824857 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:50.824857 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:50.825090 (+ 233us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:50.825135 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:50.825151 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:50.825224 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:50.825334 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 07:07:50.825433 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":71,"threads_started":1}
I20260808 07:07:50.844471 19244 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:50.845297 19244 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:50.852890 19244 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d04657f8933048989df59c067e8c5baf: Generated new TSK 0
I20260808 07:07:50.853148 19244 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:07:50.860113 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36035
--builtin_ntp_servers=127.9.94.20:41493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 07:07:50.963616 19249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:50.963843 19249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:50.963867 19249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:50.965164 19249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:50.965212 19249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:50.965240 19249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:50.966691 19249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:50.967000 19249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:50.967339 19249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:50.973100 19257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:50.973031 19255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:50.973040 19254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:50.973359 19249 server_base.cc:1034] running on GCE node
I20260808 07:07:50.973658 19249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:50.973942 19249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:50.975129 19249 hybrid_clock.cc:648] HybridClock initialized: now 1786172870975116 us; error 32 us; skew 500 ppm
I20260808 07:07:50.976691 19249 webserver.cc:460] Webserver started at http://127.9.94.1:34953/ using document root <none> and password file <none>
I20260808 07:07:50.977069 19249 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:50.977156 19249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:50.977345 19249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:50.978609 19249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "3b2438d95639451daf297bb4fd9ea61c"
format_stamp: "Formatted at 2026-08-08 07:07:50 on dist-test-slave-77v9"
server_key: "2ae8e7cc6dac04301b924a6783fe7ed8"
server_key_iv: "70b2f4472f3a55844f737705f6a457b7"
server_key_version: "encryptionkey@0"
I20260808 07:07:50.979031 19249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "3b2438d95639451daf297bb4fd9ea61c"
format_stamp: "Formatted at 2026-08-08 07:07:50 on dist-test-slave-77v9"
server_key: "2ae8e7cc6dac04301b924a6783fe7ed8"
server_key_iv: "70b2f4472f3a55844f737705f6a457b7"
server_key_version: "encryptionkey@0"
I20260808 07:07:50.980572 19249 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:07:50.981592 19263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:50.981801 19249 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:50.981932 19249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "3b2438d95639451daf297bb4fd9ea61c"
format_stamp: "Formatted at 2026-08-08 07:07:50 on dist-test-slave-77v9"
server_key: "2ae8e7cc6dac04301b924a6783fe7ed8"
server_key_iv: "70b2f4472f3a55844f737705f6a457b7"
server_key_version: "encryptionkey@0"
I20260808 07:07:50.982023 19249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:50.994854 19249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:50.995254 19249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:50.995440 19249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:50.995723 19249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:50.996155 19249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:50.996217 19249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:50.996264 19249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:50.996295 19249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.003139 19249 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:42457
I20260808 07:07:51.003193 19379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:42457 every 8 connection(s)
I20260808 07:07:51.003574 19249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:07:51.007596 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 19249
I20260808 07:07:51.007709 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:51.008004 9592 external_mini_cluster.cc:1428] Setting key 00c2cde647862e1a31b8604da9d454f2
I20260808 07:07:51.009327 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36035
--builtin_ntp_servers=127.9.94.20:41493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 07:07:51.010382 19245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:51.004450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:38771 (local address 127.9.94.62:36035)
0808 07:07:51.004533 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:51.004535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:51.004778 (+ 243us) server_negotiation.cc:407] Connection header received
0808 07:07:51.005330 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:51.005331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:51.005345 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:51.005438 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:51.006273 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:51.006816 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:51.008457 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:51.008791 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:51.008911 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:51.010042 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:51.010044 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:51.010044 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:51.010050 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:51.010067 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:51.010071 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:51.010132 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:51.010228 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 07:07:51.010261 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 07:07:51.010509 19382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:51.004402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36035 (local address 127.9.94.1:38771)
0808 07:07:51.004606 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:51.004651 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:51.005206 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:51.005553 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:51.005557 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:51.005565 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:51.006173 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:51.006178 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:51.006999 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:51.007000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:51.008295 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:51.008298 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:51.008948 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:51.008949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:51.009211 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:51.009834 (+ 623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:07:51.009835 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:51.009909 (+ 74us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:07:51.009933 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:51.010141 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:51.010145 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:51.010149 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:51.010204 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 07:07:51.010287 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":93,"threads_started":1}
I20260808 07:07:51.011299 19380 heartbeater.cc:347] Connected to a master server at 127.9.94.62:36035
I20260808 07:07:51.011421 19380 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:51.011649 19380 heartbeater.cc:511] Master 127.9.94.62:36035 requested a full tablet report, sending...
I20260808 07:07:51.012382 19186 ts_manager.cc:194] Registered new tserver with Master: 3b2438d95639451daf297bb4fd9ea61c (127.9.94.1:42457)
I20260808 07:07:51.013281 19186 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.94.1:38771
W20260808 07:07:51.101871 19383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:51.102125 19383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:51.102151 19383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:51.103484 19383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:51.103525 19383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:51.103554 19383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:51.105022 19383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:51.105254 19383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:51.105541 19383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:51.111327 19389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:51.111542 19388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:51.111668 19391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:51.111696 19383 server_base.cc:1034] running on GCE node
I20260808 07:07:51.111953 19383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:51.112241 19383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:51.113471 19383 hybrid_clock.cc:648] HybridClock initialized: now 1786172871113422 us; error 63 us; skew 500 ppm
I20260808 07:07:51.115288 19383 webserver.cc:460] Webserver started at http://127.9.94.2:44225/ using document root <none> and password file <none>
I20260808 07:07:51.115574 19383 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:51.115650 19383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:51.115818 19383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:51.117245 19383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "c070a623a0a34aeda66da0d725df61b4"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "ba9a6264342ec0ecc0a4955a721a74e6"
server_key_iv: "d51872192091c55f5720b1af2bb4c52a"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.117745 19383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "c070a623a0a34aeda66da0d725df61b4"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "ba9a6264342ec0ecc0a4955a721a74e6"
server_key_iv: "d51872192091c55f5720b1af2bb4c52a"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.119832 19383 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260808 07:07:51.120970 19397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.121407 19383 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260808 07:07:51.121575 19383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "c070a623a0a34aeda66da0d725df61b4"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "ba9a6264342ec0ecc0a4955a721a74e6"
server_key_iv: "d51872192091c55f5720b1af2bb4c52a"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.121672 19383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:51.154467 19383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:51.154832 19383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:51.154994 19383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:51.155270 19383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:51.155654 19383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:51.155709 19383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.155747 19383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:51.155800 19383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.162681 19383 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:45165
I20260808 07:07:51.162750 19514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:45165 every 8 connection(s)
I20260808 07:07:51.163123 19383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:07:51.168159 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 19383
I20260808 07:07:51.168329 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:07:51.168589 9592 external_mini_cluster.cc:1428] Setting key 90b0484e1e04eac6ea8ebf7058305ecc
I20260808 07:07:51.169436 19245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:51.163993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:58539 (local address 127.9.94.62:36035)
0808 07:07:51.164074 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:51.164077 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:51.164348 (+ 271us) server_negotiation.cc:407] Connection header received
0808 07:07:51.164933 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:51.164934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:51.164946 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:51.165012 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:51.165729 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:51.166296 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:51.167499 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:51.167709 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:51.167778 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:51.169044 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:51.169045 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:51.169046 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:51.169051 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:51.169070 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:51.169076 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:51.169146 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:51.169257 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 07:07:51.169285 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 07:07:51.169694 19517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:51.163979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36035 (local address 127.9.94.2:58539)
0808 07:07:51.164197 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:51.164245 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:51.164803 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:51.165069 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:51.165073 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:51.165081 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:51.165613 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:51.165617 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:51.166451 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:51.166452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:51.167398 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:51.167401 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:51.167826 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:51.167827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:51.168026 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:51.168794 (+ 768us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:07:51.168800 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:51.168887 (+ 87us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:07:51.168931 (+ 44us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:51.169160 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:51.169166 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:51.169169 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:51.169252 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 07:07:51.169369 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":97,"threads_started":1}
I20260808 07:07:51.169896 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36035
--builtin_ntp_servers=127.9.94.20:41493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 07:07:51.170405 19515 heartbeater.cc:347] Connected to a master server at 127.9.94.62:36035
I20260808 07:07:51.170498 19515 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:51.170720 19515 heartbeater.cc:511] Master 127.9.94.62:36035 requested a full tablet report, sending...
I20260808 07:07:51.171182 19186 ts_manager.cc:194] Registered new tserver with Master: c070a623a0a34aeda66da0d725df61b4 (127.9.94.2:45165)
I20260808 07:07:51.171751 19186 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.94.2:58539
W20260808 07:07:51.260416 19518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:51.260725 19518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:51.260769 19518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:51.262142 19518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:51.262224 19518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:51.262275 19518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:51.264065 19518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:51.264387 19518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:51.264735 19518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:51.270448 19523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:51.270440 19526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:51.270462 19524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:51.271009 19518 server_base.cc:1034] running on GCE node
I20260808 07:07:51.271256 19518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:51.271782 19518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:51.272969 19518 hybrid_clock.cc:648] HybridClock initialized: now 1786172871272926 us; error 77 us; skew 500 ppm
I20260808 07:07:51.274775 19518 webserver.cc:460] Webserver started at http://127.9.94.3:34177/ using document root <none> and password file <none>
I20260808 07:07:51.275105 19518 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:51.275193 19518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:51.275391 19518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:51.276857 19518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "b123334c689347d7b5b3433d0de1f32e"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "658c4efd2279256771f6f8c9d1f42afa"
server_key_iv: "77d37d3f830c218c378034576b0a27c4"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.277287 19518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "b123334c689347d7b5b3433d0de1f32e"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "658c4efd2279256771f6f8c9d1f42afa"
server_key_iv: "77d37d3f830c218c378034576b0a27c4"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.279354 19518 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 07:07:51.280227 19532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.280463 19518 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:51.280572 19518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "b123334c689347d7b5b3433d0de1f32e"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "658c4efd2279256771f6f8c9d1f42afa"
server_key_iv: "77d37d3f830c218c378034576b0a27c4"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.280659 19518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:51.323660 19518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:51.324079 19518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:51.324265 19518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:51.324592 19518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:51.325053 19518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:51.325115 19518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.325199 19518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:51.325230 19518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.333976 19518 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:38421
I20260808 07:07:51.334023 19646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:38421 every 8 connection(s)
I20260808 07:07:51.334430 19518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:07:51.337428 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 19518
I20260808 07:07:51.337555 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:07:51.338023 9592 external_mini_cluster.cc:1428] Setting key 4fa664d708530f4d5bdcd2e3fbde00d0
I20260808 07:07:51.340790 19245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:51.335360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:39807 (local address 127.9.94.62:36035)
0808 07:07:51.335423 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:51.335425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:51.335701 (+ 276us) server_negotiation.cc:407] Connection header received
0808 07:07:51.336222 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:51.336224 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:51.336236 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:51.336313 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:51.337128 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:51.337726 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:51.339439 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:51.339634 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:51.339693 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:51.340549 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:51.340550 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:51.340550 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:51.340555 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:51.340568 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:51.340572 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:51.340617 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:51.340703 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 07:07:51.340730 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:07:51.341096 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:51.335297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36035 (local address 127.9.94.3:39807)
0808 07:07:51.335531 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:51.335577 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:51.336109 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:51.336388 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:51.336391 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:51.336402 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:51.337012 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:51.337018 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:51.337904 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:51.337905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:51.339353 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:51.339356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:51.339728 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:51.339729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:51.339864 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:51.340414 (+ 550us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:07:51.340414 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:51.340445 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:07:51.340469 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:51.340632 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:51.340636 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:51.340638 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:07:51.340695 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 07:07:51.340793 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":108,"threads_started":1}
I20260808 07:07:51.341540 19647 heartbeater.cc:347] Connected to a master server at 127.9.94.62:36035
I20260808 07:07:51.341671 19647 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:51.341876 19647 heartbeater.cc:511] Master 127.9.94.62:36035 requested a full tablet report, sending...
I20260808 07:07:51.342322 19186 ts_manager.cc:194] Registered new tserver with Master: b123334c689347d7b5b3433d0de1f32e (127.9.94.3:38421)
I20260808 07:07:51.342752 19186 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.94.3:39807
I20260808 07:07:51.350580 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:07:51.352931 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 19249
W20260808 07:07:51.353018 19245 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:51.352313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41156 (local address 127.9.94.62:36035)
0808 07:07:51.352405 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:51.352407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:51.352504 (+ 97us) server_negotiation.cc:407] Connection header received
0808 07:07:51.352586 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:51.352587 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:51.352600 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:51.352658 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:51.352939 (+ 281us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41156: BlockingRecv error: recv got EOF from 127.0.0.1:41156 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 07:07:51.361742 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 19383
I20260808 07:07:51.368079 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 19518
I20260808 07:07:51.374014 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 19154
2026-08-08T07:07:51Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (724 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T07:07:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:51Z Disabled control of system clock
I20260808 07:07:51.404946 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:40919
--webserver_interface=127.9.94.62
--webserver_port=0
--builtin_ntp_servers=127.9.94.20:35287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:40919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 07:07:51.504385 19658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:51.504642 19658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:51.504669 19658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:51.506047 19658 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:51.506101 19658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:51.506116 19658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:51.506130 19658 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:51.506145 19658 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:51.508299 19658 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:40919
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:40919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:51.508606 19658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:51.509016 19658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:51.514832 19664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:51.514824 19665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:51.515332 19658 server_base.cc:1034] running on GCE node
W20260808 07:07:51.514951 19667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:51.515776 19658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:51.516193 19658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:51.517412 19658 hybrid_clock.cc:648] HybridClock initialized: now 1786172871517384 us; error 58 us; skew 500 ppm
I20260808 07:07:51.519582 19658 webserver.cc:460] Webserver started at http://127.9.94.62:33931/ using document root <none> and password file <none>
I20260808 07:07:51.519891 19658 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:51.519979 19658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:51.520157 19658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:51.521510 19658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "39436fd546934ee9894f6519e61ddcff"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "12fa1bb30e20d4ac5df25212c5d066a2"
server_key_iv: "5979f5db844f73e71ddd3eff52637cbc"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.521947 19658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "39436fd546934ee9894f6519e61ddcff"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "12fa1bb30e20d4ac5df25212c5d066a2"
server_key_iv: "5979f5db844f73e71ddd3eff52637cbc"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.523622 19658 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:07:51.524706 19673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.524967 19658 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:51.525097 19658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "39436fd546934ee9894f6519e61ddcff"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "12fa1bb30e20d4ac5df25212c5d066a2"
server_key_iv: "5979f5db844f73e71ddd3eff52637cbc"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.525189 19658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:51.529093 19658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:51.529403 19658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:51.529568 19658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:51.534185 19658 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:40919
I20260808 07:07:51.534339 19725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:40919 every 8 connection(s)
I20260808 07:07:51.534648 19658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:51.535526 19726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:51.538635 19726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff: Bootstrap starting.
I20260808 07:07:51.539458 19726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:51.539773 19726 log.cc:824] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:51.540613 19726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff: No bootstrap required, opened a new log
I20260808 07:07:51.540977 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 19658
I20260808 07:07:51.541059 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:51.541266 9592 external_mini_cluster.cc:1428] Setting key 38d03199240afe8677d87838effa4c88
I20260808 07:07:51.543162 19726 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39436fd546934ee9894f6519e61ddcff" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40919 } }
I20260808 07:07:51.543354 19726 raft_consensus.cc:374] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:51.543401 19726 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39436fd546934ee9894f6519e61ddcff, State: Initialized, Role: FOLLOWER
I20260808 07:07:51.543581 19726 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39436fd546934ee9894f6519e61ddcff" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40919 } }
I20260808 07:07:51.543713 19726 raft_consensus.cc:388] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:51.543762 19726 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:51.543818 19726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:51.544656 19731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:51.541873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35138 (local address 127.9.94.62:40919)
0808 07:07:51.542078 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:51.542085 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:51.542111 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:07:51.543161 (+ 1050us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:51.543169 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:51.543210 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:51.543390 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:51.544118 (+ 728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:51.544122 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:51.544122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:51.544127 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:51.544177 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:51.544193 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:51.544278 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:51.544342 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 07:07:51.544409 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
I20260808 07:07:51.544665 19726 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39436fd546934ee9894f6519e61ddcff" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40919 } }
I20260808 07:07:51.544833 19726 leader_election.cc:302] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39436fd546934ee9894f6519e61ddcff; no voters:
I20260808 07:07:51.545010 19726 leader_election.cc:288] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:51.545286 19726 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:51.545790 19732 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:51.545949 19732 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [term 1 LEADER]: Becoming Leader. State: Replica: 39436fd546934ee9894f6519e61ddcff, State: Running, Role: LEADER
I20260808 07:07:51.546062 19732 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39436fd546934ee9894f6519e61ddcff" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40919 } }
I20260808 07:07:51.546552 19736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39436fd546934ee9894f6519e61ddcff. Latest consensus state: current_term: 1 leader_uuid: "39436fd546934ee9894f6519e61ddcff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39436fd546934ee9894f6519e61ddcff" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40919 } } }
I20260808 07:07:51.546691 19736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:51.546814 19733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39436fd546934ee9894f6519e61ddcff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39436fd546934ee9894f6519e61ddcff" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40919 } } }
I20260808 07:07:51.547200 19733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff [sys.catalog]: This master's current role is: LEADER
W20260808 07:07:51.547381 19746 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:07:51.547448 19746 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:07:51.547874 19747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:51.548071 19747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:51.549700 19747 catalog_manager.cc:1347] Generated new cluster ID: 55b1c06faa0b4ab5895700c4159f617c
I20260808 07:07:51.549765 19747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:51.561393 19747 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:51.561600 19747 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:51.571820 19747 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 39436fd546934ee9894f6519e61ddcff: Generated new TSK 0
I20260808 07:07:51.572049 19747 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:07:51.579217 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:40919
--builtin_ntp_servers=127.9.94.20:35287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 07:07:51.680963 19751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:51.681177 19751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:51.681201 19751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:51.682413 19751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:51.682456 19751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:51.682482 19751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:51.683835 19751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:40919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:51.684110 19751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:51.684429 19751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:51.690881 19756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:51.691123 19751 server_base.cc:1034] running on GCE node
W20260808 07:07:51.690881 19760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:51.690918 19758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:51.691568 19751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:51.691880 19751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:51.693070 19751 hybrid_clock.cc:648] HybridClock initialized: now 1786172871693057 us; error 36 us; skew 500 ppm
I20260808 07:07:51.694708 19751 webserver.cc:460] Webserver started at http://127.9.94.1:34519/ using document root <none> and password file <none>
I20260808 07:07:51.695007 19751 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:51.695084 19751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:51.695263 19751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:51.696558 19751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "132b95126ffe4d38b95e43a4ed3ebb22"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "d3beaf7345a9e3e339c61815eaf5cb37"
server_key_iv: "ed91a58da0dc2013925b60f6474f016a"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.696993 19751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "132b95126ffe4d38b95e43a4ed3ebb22"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "d3beaf7345a9e3e339c61815eaf5cb37"
server_key_iv: "ed91a58da0dc2013925b60f6474f016a"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.698534 19751 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:51.699512 19766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.700129 19751 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260808 07:07:51.700258 19751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "132b95126ffe4d38b95e43a4ed3ebb22"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "d3beaf7345a9e3e339c61815eaf5cb37"
server_key_iv: "ed91a58da0dc2013925b60f6474f016a"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.700363 19751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:51.704442 19751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:51.704752 19751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:51.704989 19751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:51.705240 19751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:51.705587 19751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:51.705649 19751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.705698 19751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:51.705735 19751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.712812 19751 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:43903
I20260808 07:07:51.712896 19883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:43903 every 8 connection(s)
I20260808 07:07:51.713268 19751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:07:51.716580 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 19751
I20260808 07:07:51.716691 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:51.716972 9592 external_mini_cluster.cc:1428] Setting key f99485596f83c9c913ec323fc0dfe11d
I20260808 07:07:51.717198 19731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:51.714141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:47971 (local address 127.9.94.62:40919)
0808 07:07:51.714226 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:51.714229 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:51.714509 (+ 280us) server_negotiation.cc:407] Connection header received
0808 07:07:51.715062 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:51.715063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:51.715069 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:51.715131 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:51.716585 (+ 1454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:51.716587 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:51.716587 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:51.716592 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:51.716612 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:51.716617 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:51.716763 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:51.716984 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 07:07:51.717117 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 07:07:51.717245 19888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:51.714124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:40919 (local address 127.9.94.1:47971)
0808 07:07:51.714359 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:51.714398 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:51.714922 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:51.715265 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:51.715269 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:51.715278 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:51.716367 (+ 1089us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:07:51.716368 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:51.716413 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:07:51.716453 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:51.716764 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:51.716771 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:51.716774 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:51.716933 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 07:07:51.717008 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":120,"threads_started":1}
I20260808 07:07:51.717903 19884 heartbeater.cc:347] Connected to a master server at 127.9.94.62:40919
I20260808 07:07:51.718003 19884 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:51.718176 19884 heartbeater.cc:511] Master 127.9.94.62:40919 requested a full tablet report, sending...
I20260808 07:07:51.718664 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:40919
--builtin_ntp_servers=127.9.94.20:35287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 07:07:51.718823 19689 ts_manager.cc:194] Registered new tserver with Master: 132b95126ffe4d38b95e43a4ed3ebb22 (127.9.94.1:43903)
W20260808 07:07:51.808189 19889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:51.808440 19889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:51.808470 19889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:51.809904 19889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:51.809955 19889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:51.809985 19889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:51.811547 19889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:40919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:51.811829 19889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:51.812194 19889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:51.817922 19894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:51.817909 19895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:51.818435 19897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:51.818614 19889 server_base.cc:1034] running on GCE node
I20260808 07:07:51.818899 19889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:51.819128 19889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:51.820302 19889 hybrid_clock.cc:648] HybridClock initialized: now 1786172871820258 us; error 69 us; skew 500 ppm
I20260808 07:07:51.821846 19889 webserver.cc:460] Webserver started at http://127.9.94.2:44279/ using document root <none> and password file <none>
I20260808 07:07:51.822165 19889 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:51.822225 19889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:51.822382 19889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:51.823634 19889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "a9f2188f123849e397cbcc1e09c5678f"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "ebfbaf122449295600121aba6399d451"
server_key_iv: "df282b9a609524c056709f1024b79629"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.824046 19889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "a9f2188f123849e397cbcc1e09c5678f"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "ebfbaf122449295600121aba6399d451"
server_key_iv: "df282b9a609524c056709f1024b79629"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.825718 19889 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260808 07:07:51.826706 19903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.827014 19889 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:51.827136 19889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "a9f2188f123849e397cbcc1e09c5678f"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "ebfbaf122449295600121aba6399d451"
server_key_iv: "df282b9a609524c056709f1024b79629"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.827250 19889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:51.831177 19889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:51.831491 19889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:51.831655 19889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:51.831897 19889 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:51.832237 19889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:51.832301 19889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.832348 19889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:51.832384 19889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.839524 19889 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:39239
I20260808 07:07:51.839564 20023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:39239 every 8 connection(s)
I20260808 07:07:51.839942 19889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:07:51.843297 19731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:51.840773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:52407 (local address 127.9.94.62:40919)
0808 07:07:51.840902 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:51.840905 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:51.841226 (+ 321us) server_negotiation.cc:407] Connection header received
0808 07:07:51.841735 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:51.841736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:51.841742 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:51.841813 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:51.843006 (+ 1193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:51.843008 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:51.843008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:51.843020 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:51.843039 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:51.843044 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:51.843105 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:51.843222 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 07:07:51.843239 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 07:07:51.843478 20026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:51.840669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:40919 (local address 127.9.94.2:52407)
0808 07:07:51.841092 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:51.841142 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:51.841628 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:51.841867 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:51.841870 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:51.841878 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:51.842845 (+ 967us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:07:51.842846 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:51.842875 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:07:51.842904 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:51.843114 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:51.843118 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:51.843120 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:07:51.843191 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 07:07:51.843251 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":125,"threads_started":1}
I20260808 07:07:51.844163 20024 heartbeater.cc:347] Connected to a master server at 127.9.94.62:40919
I20260808 07:07:51.844261 20024 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:51.844378 20024 heartbeater.cc:511] Master 127.9.94.62:40919 requested a full tablet report, sending...
I20260808 07:07:51.844748 19689 ts_manager.cc:194] Registered new tserver with Master: a9f2188f123849e397cbcc1e09c5678f (127.9.94.2:39239)
I20260808 07:07:51.845341 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 19889
I20260808 07:07:51.845534 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:07:51.845746 9592 external_mini_cluster.cc:1428] Setting key c1d185380e63037c2a38309049b3fe7b
I20260808 07:07:51.847029 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:40919
--builtin_ntp_servers=127.9.94.20:35287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 07:07:51.936410 20027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:51.936663 20027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:51.936691 20027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:51.938066 20027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:51.938118 20027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:51.938148 20027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:51.939668 20027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:40919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:51.939950 20027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:51.940316 20027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:51.946322 20032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:51.946328 20035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:51.946357 20033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:51.946532 20027 server_base.cc:1034] running on GCE node
I20260808 07:07:51.946879 20027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:51.947147 20027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:51.948350 20027 hybrid_clock.cc:648] HybridClock initialized: now 1786172871948328 us; error 41 us; skew 500 ppm
I20260808 07:07:51.949832 20027 webserver.cc:460] Webserver started at http://127.9.94.3:39325/ using document root <none> and password file <none>
I20260808 07:07:51.950093 20027 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:51.950168 20027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:51.950330 20027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:51.951442 20027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "8583c777ef184dc28b3ae179b71a9e29"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "d1f35f661059406310534f739ed4adf2"
server_key_iv: "672640b24fe5e756ebb5f0a5d46ffa17"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.951828 20027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "8583c777ef184dc28b3ae179b71a9e29"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "d1f35f661059406310534f739ed4adf2"
server_key_iv: "672640b24fe5e756ebb5f0a5d46ffa17"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.953446 20027 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 07:07:51.954452 20041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.954689 20027 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:51.954824 20027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "8583c777ef184dc28b3ae179b71a9e29"
format_stamp: "Formatted at 2026-08-08 07:07:51 on dist-test-slave-77v9"
server_key: "d1f35f661059406310534f739ed4adf2"
server_key_iv: "672640b24fe5e756ebb5f0a5d46ffa17"
server_key_version: "encryptionkey@0"
I20260808 07:07:51.954926 20027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:51.958849 20027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:51.959144 20027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:51.959304 20027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:51.959525 20027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:51.959847 20027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:51.959904 20027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.959945 20027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:51.959972 20027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:51.966238 20027 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:42459
I20260808 07:07:51.966288 20159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:42459 every 8 connection(s)
I20260808 07:07:51.966675 20027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:07:51.970482 19731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:51.967581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:38689 (local address 127.9.94.62:40919)
0808 07:07:51.967713 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:51.967716 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:51.967918 (+ 202us) server_negotiation.cc:407] Connection header received
0808 07:07:51.968470 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:51.968472 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:51.968482 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:51.968534 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:51.970194 (+ 1660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:51.970199 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:51.970199 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:07:51.970209 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:51.970224 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:07:51.970228 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:51.970296 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:51.970386 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 07:07:51.970405 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 07:07:51.970711 20162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:51.967474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:40919 (local address 127.9.94.3:38689)
0808 07:07:51.967784 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:51.967831 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:51.968347 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:51.968625 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:51.968629 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:51.968641 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:51.970010 (+ 1369us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:07:51.970011 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:51.970056 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:07:51.970086 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:51.970293 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:51.970307 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:51.970311 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:51.970396 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 07:07:51.970484 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":124,"threads_started":1}
I20260808 07:07:51.971156 20160 heartbeater.cc:347] Connected to a master server at 127.9.94.62:40919
I20260808 07:07:51.971251 20160 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:51.971374 20160 heartbeater.cc:511] Master 127.9.94.62:40919 requested a full tablet report, sending...
I20260808 07:07:51.971740 19689 ts_manager.cc:194] Registered new tserver with Master: 8583c777ef184dc28b3ae179b71a9e29 (127.9.94.3:42459)
I20260808 07:07:51.973416 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 20027
I20260808 07:07:51.973521 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:07:51.973759 9592 external_mini_cluster.cc:1428] Setting key fbd9754c3a736a493a796559b4fe87d8
I20260808 07:07:51.974757 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 07:07:51.977104 19731 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:07:51.976303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35148 (local address 127.9.94.62:40919)
0808 07:07:51.976489 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:51.976491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:51.976575 (+ 84us) server_negotiation.cc:407] Connection header received
0808 07:07:51.976695 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:51.976696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:51.976710 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:51.976784 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:51.976987 (+ 203us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35148: BlockingRecv error: recv got EOF from 127.0.0.1:35148 (error 108)
Metrics: {"server-negotiator.queue_time_us":147}
I20260808 07:07:51.977142 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 19751
I20260808 07:07:51.987529 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 19889
I20260808 07:07:51.994014 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 20027
I20260808 07:07:51.999789 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 19658
2026-08-08T07:07:52Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (626 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:07:52 dist-test-slave-77v9 krb5kdc[20170](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:07:52 dist-test-slave-77v9 krb5kdc[20170](info): set up 2 sockets
Aug 08 07:07:52 dist-test-slave-77v9 krb5kdc[20170](info): commencing operation
krb5kdc: starting...
W20260808 07:07:53.124377 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:07:53 dist-test-slave-77v9 krb5kdc[20170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:07:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:07:53.264663 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:38097
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:38097
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:53.356309 20184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:53.356590 20184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:53.356629 20184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:53.357894 20184 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:53.357967 20184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:53.357992 20184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:53.358024 20184 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:53.358055 20184 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:53.359622 20184 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:38097
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:38097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:53.359946 20184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:53.360193 20184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:53.365541 20193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:53.365816 20191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:53.365816 20190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:53.366241 20184 server_base.cc:1034] running on GCE node
I20260808 07:07:53.366815 20184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:53.367206 20184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:53.368458 20184 hybrid_clock.cc:648] HybridClock initialized: now 1786172873368423 us; error 58 us; skew 500 ppm
Aug 08 07:07:53 dist-test-slave-77v9 krb5kdc[20170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172873, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:53.371498 20184 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:07:53.372051 20184 webserver.cc:460] Webserver started at http://127.9.94.62:42137/ using document root <none> and password file <none>
I20260808 07:07:53.372305 20184 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:53.372387 20184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:53.372543 20184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:53.373730 20184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "9b0f865e41484e0fa9e6e350be698de9"
format_stamp: "Formatted at 2026-08-08 07:07:53 on dist-test-slave-77v9"
server_key: "f1bed3f4fb1d8be7b0b69b45cd086590"
server_key_iv: "ba8a63900b1630392030dd9ecda9024a"
server_key_version: "encryptionkey@0"
I20260808 07:07:53.374117 20184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "9b0f865e41484e0fa9e6e350be698de9"
format_stamp: "Formatted at 2026-08-08 07:07:53 on dist-test-slave-77v9"
server_key: "f1bed3f4fb1d8be7b0b69b45cd086590"
server_key_iv: "ba8a63900b1630392030dd9ecda9024a"
server_key_version: "encryptionkey@0"
I20260808 07:07:53.375906 20184 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260808 07:07:53.377131 20200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:53.377449 20184 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:07:53.377592 20184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "9b0f865e41484e0fa9e6e350be698de9"
format_stamp: "Formatted at 2026-08-08 07:07:53 on dist-test-slave-77v9"
server_key: "f1bed3f4fb1d8be7b0b69b45cd086590"
server_key_iv: "ba8a63900b1630392030dd9ecda9024a"
server_key_version: "encryptionkey@0"
I20260808 07:07:53.377684 20184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:53.391665 20184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:53.394397 20184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:53.394593 20184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:53.399240 20184 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:38097
I20260808 07:07:53.399322 20253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:38097 every 8 connection(s)
I20260808 07:07:53.399711 20184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:53.400954 20254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:53.401636 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 20184
I20260808 07:07:53.401777 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:07:53.402040 9592 external_mini_cluster.cc:1428] Setting key db94f9ded137a1cd9a9cb16fe7224fba
I20260808 07:07:53.404317 20254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9: Bootstrap starting.
I20260808 07:07:53.405049 20254 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:53.405403 20254 log.cc:824] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:53.406539 20254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9: No bootstrap required, opened a new log
I20260808 07:07:53.409065 20254 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b0f865e41484e0fa9e6e350be698de9" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38097 } }
I20260808 07:07:53.409214 20254 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:53.409236 20254 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b0f865e41484e0fa9e6e350be698de9, State: Initialized, Role: FOLLOWER
I20260808 07:07:53.409376 20254 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b0f865e41484e0fa9e6e350be698de9" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38097 } }
I20260808 07:07:53.409475 20254 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:53.409521 20254 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:53.409574 20254 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:53.410346 20254 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b0f865e41484e0fa9e6e350be698de9" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38097 } }
I20260808 07:07:53.410480 20254 leader_election.cc:302] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b0f865e41484e0fa9e6e350be698de9; no voters:
I20260808 07:07:53.410656 20254 leader_election.cc:288] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [CANDIDATE]: Term 1 election: Requested vote from peers
Aug 08 07:07:53 dist-test-slave-77v9 krb5kdc[20170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:53.410830 20259 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:53.410964 20254 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:53.411039 20259 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [term 1 LEADER]: Becoming Leader. State: Replica: 9b0f865e41484e0fa9e6e350be698de9, State: Running, Role: LEADER
I20260808 07:07:53.411139 20259 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b0f865e41484e0fa9e6e350be698de9" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38097 } }
I20260808 07:07:53.411463 20259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b0f865e41484e0fa9e6e350be698de9. Latest consensus state: current_term: 1 leader_uuid: "9b0f865e41484e0fa9e6e350be698de9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b0f865e41484e0fa9e6e350be698de9" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38097 } } }
I20260808 07:07:53.411533 20259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:53.411650 20260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b0f865e41484e0fa9e6e350be698de9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b0f865e41484e0fa9e6e350be698de9" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38097 } } }
I20260808 07:07:53.411741 20260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:53.411844 20264 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:53.412361 20264 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:53.413957 20264 catalog_manager.cc:1347] Generated new cluster ID: 78b099861cdd48b89cec54d030a66eaa
I20260808 07:07:53.414011 20264 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:53.415853 20257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:53.402682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47684 (local address 127.9.94.62:38097)
0808 07:07:53.402907 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:53.402918 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:53.402952 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:07:53.403541 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:53.403551 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:53.403616 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:53.403773 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:53.404949 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:53.406189 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:53.407103 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:53.407746 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:53.407880 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:53.411306 (+ 3426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:53.411311 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:53.411312 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:53.411324 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:53.414073 (+ 2749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:53.414501 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:53.414504 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:53.414504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:53.414609 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:53.414828 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:53.414829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:53.414830 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:53.415139 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:53.415308 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:53.415383 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 07:07:53.415645 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":105,"threads_started":1}
I20260808 07:07:53.435776 20264 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:53.436443 20264 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:53.439702 20264 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9: Generated new TSK 0
I20260808 07:07:53.439913 20264 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:07:53.481058 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:38097
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:53.589493 20281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:53.589738 20281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:53.589780 20281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:53.590960 20281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:53.591027 20281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:53.591074 20281 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:07:53.592547 20281 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:38097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:53.592864 20281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:53.593107 20281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:53.598670 20286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:53.598664 20287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:53.598663 20289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:53.598696 20281 server_base.cc:1034] running on GCE node
I20260808 07:07:53.599126 20281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:53.599434 20281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:53.600643 20281 hybrid_clock.cc:648] HybridClock initialized: now 1786172873600608 us; error 54 us; skew 500 ppm
Aug 08 07:07:53 dist-test-slave-77v9 krb5kdc[20170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172873, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:53.607908 20281 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:07:53.608410 20281 webserver.cc:460] Webserver started at http://127.9.94.1:36483/ using document root <none> and password file <none>
I20260808 07:07:53.608603 20281 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:53.608645 20281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:53.608740 20281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:53.609826 20281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "25d402d2d47c4738807c7e3f1a6372c4"
format_stamp: "Formatted at 2026-08-08 07:07:53 on dist-test-slave-77v9"
server_key: "109160b5cc4bfb8808ab96b368b6581c"
server_key_iv: "aa1b069be8ab05a01689a772f6cc44db"
server_key_version: "encryptionkey@0"
I20260808 07:07:53.610134 20281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "25d402d2d47c4738807c7e3f1a6372c4"
format_stamp: "Formatted at 2026-08-08 07:07:53 on dist-test-slave-77v9"
server_key: "109160b5cc4bfb8808ab96b368b6581c"
server_key_iv: "aa1b069be8ab05a01689a772f6cc44db"
server_key_version: "encryptionkey@0"
I20260808 07:07:53.611539 20281 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:07:53.612463 20296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:53.612684 20281 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:53.612785 20281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "25d402d2d47c4738807c7e3f1a6372c4"
format_stamp: "Formatted at 2026-08-08 07:07:53 on dist-test-slave-77v9"
server_key: "109160b5cc4bfb8808ab96b368b6581c"
server_key_iv: "aa1b069be8ab05a01689a772f6cc44db"
server_key_version: "encryptionkey@0"
I20260808 07:07:53.612885 20281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:53.625694 20281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:53.628062 20281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:53.628180 20281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:53.628491 20281 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:53.628872 20281 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:53.628921 20281 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:53.628943 20281 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:53.628974 20281 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:53.635290 20281 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:43195
I20260808 07:07:53.635353 20413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:43195 every 8 connection(s)
I20260808 07:07:53.635690 20281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:07:53.638761 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 20281
I20260808 07:07:53.638891 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:53.639276 9592 external_mini_cluster.cc:1428] Setting key 3abb4a9fe661d1a22281bc99429c7236
Aug 08 07:07:53 dist-test-slave-77v9 krb5kdc[20170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172873, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:53.648313 20417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:53.636488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:38097 (local address 127.9.94.1:42745)
0808 07:07:53.636657 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:53.636697 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:53.637313 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:53.637778 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:53.637782 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:53.638471 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:53.638910 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:53.638918 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:53.639969 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:53.639970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:53.641293 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:53.641297 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:53.641846 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:53.641847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:53.642011 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:53.642680 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:53.642729 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:53.644455 (+ 1726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:53.646744 (+ 2289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:53.646751 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:53.646752 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:53.647025 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:53.647274 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:53.647275 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:53.647275 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:53.647395 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:53.647748 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:53.647755 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:53.647890 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 07:07:53.647992 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 07:07:53.648129 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":70,"threads_started":1}
I20260808 07:07:53.648310 20257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:53.636584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:42745 (local address 127.9.94.62:38097)
0808 07:07:53.636676 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:53.636679 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:53.636836 (+ 157us) server_negotiation.cc:407] Connection header received
0808 07:07:53.637451 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:53.637452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:53.637465 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:53.637538 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:53.639136 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:53.639857 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:53.641416 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:53.641652 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:53.641825 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:53.644576 (+ 2751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:53.644577 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:53.644578 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:53.644587 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:53.646632 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:53.647115 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:53.647116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:53.647117 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:53.647193 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:53.647468 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:53.647469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:53.647469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:53.647640 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:53.647745 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:53.648065 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 07:07:53.648177 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 07:07:53.648986 20414 heartbeater.cc:347] Connected to a master server at 127.9.94.62:38097
I20260808 07:07:53.649133 20414 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:53.649353 20414 heartbeater.cc:511] Master 127.9.94.62:38097 requested a full tablet report, sending...
I20260808 07:07:53.650391 20217 ts_manager.cc:194] Registered new tserver with Master: 25d402d2d47c4738807c7e3f1a6372c4 (127.9.94.1:43195)
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
I20260808 07:07:53.651443 20217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:42745
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:07:53.672730 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:38097
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:53.763399 20420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:53.763615 20420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:53.763640 20420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:53.764880 20420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:53.764925 20420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:53.764952 20420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:07:53.766498 20420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:38097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:53.766803 20420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:53.767047 20420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:53.772487 20428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:53.772485 20426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:53.772696 20425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:53.773715 20420 server_base.cc:1034] running on GCE node
I20260808 07:07:53.774029 20420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:53.774305 20420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:53.775498 20420 hybrid_clock.cc:648] HybridClock initialized: now 1786172873775479 us; error 43 us; skew 500 ppm
Aug 08 07:07:53 dist-test-slave-77v9 krb5kdc[20170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172873, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:53.778548 20420 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:07:53.779031 20420 webserver.cc:460] Webserver started at http://127.9.94.2:39591/ using document root <none> and password file <none>
I20260808 07:07:53.779258 20420 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:53.779304 20420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:53.779409 20420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:53.780658 20420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "36135804b7944c109e66a7dbe51c6ca7"
format_stamp: "Formatted at 2026-08-08 07:07:53 on dist-test-slave-77v9"
server_key: "4a5f6b5ecde726b7884b3deac93e1f90"
server_key_iv: "f442d7e12cecd0f2daf0845ab3469bd7"
server_key_version: "encryptionkey@0"
I20260808 07:07:53.781087 20420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "36135804b7944c109e66a7dbe51c6ca7"
format_stamp: "Formatted at 2026-08-08 07:07:53 on dist-test-slave-77v9"
server_key: "4a5f6b5ecde726b7884b3deac93e1f90"
server_key_iv: "f442d7e12cecd0f2daf0845ab3469bd7"
server_key_version: "encryptionkey@0"
I20260808 07:07:53.782872 20420 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260808 07:07:53.784200 20435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:53.784461 20420 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:53.784565 20420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "36135804b7944c109e66a7dbe51c6ca7"
format_stamp: "Formatted at 2026-08-08 07:07:53 on dist-test-slave-77v9"
server_key: "4a5f6b5ecde726b7884b3deac93e1f90"
server_key_iv: "f442d7e12cecd0f2daf0845ab3469bd7"
server_key_version: "encryptionkey@0"
I20260808 07:07:53.784631 20420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:53.801795 20420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:53.804392 20420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:53.804527 20420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:53.804761 20420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:53.805146 20420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:53.805187 20420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:53.805217 20420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:53.805231 20420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:53.811992 20420 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:37981
I20260808 07:07:53.812098 20553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:37981 every 8 connection(s)
I20260808 07:07:53.812443 20420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:07:53 dist-test-slave-77v9 krb5kdc[20170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172873, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:53.820725 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 20420
I20260808 07:07:53.820920 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:07:53.821183 9592 external_mini_cluster.cc:1428] Setting key 60754174e7cd0c9da26117c0e31435ba
I20260808 07:07:53.823763 20257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:53.813431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:58771 (local address 127.9.94.62:38097)
0808 07:07:53.813525 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:53.813528 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:53.813680 (+ 152us) server_negotiation.cc:407] Connection header received
0808 07:07:53.814288 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:53.814289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:53.814310 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:53.814367 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:53.815326 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:53.815944 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:53.817235 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:53.817444 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:53.817509 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:53.819934 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:53.819936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:53.819936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:53.819945 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:53.821791 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:53.822529 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:53.822530 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:53.822531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:53.822596 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:53.822942 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:53.822943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:53.822943 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:53.823065 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:53.823134 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:53.823538 (+ 404us) server_negotiation.cc:299] Negotiation successful
0808 07:07:53.823629 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 07:07:53.823958 20557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:53.813359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:38097 (local address 127.9.94.2:58771)
0808 07:07:53.813532 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:53.813579 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:53.814149 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:53.814435 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:53.814438 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:53.815044 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:53.815241 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:53.815246 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:53.816050 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:53.816051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:53.817155 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:53.817157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:53.817534 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:53.817535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:53.817646 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:53.818184 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:53.818192 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:53.819742 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:53.822097 (+ 2355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:53.822104 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:53.822114 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:53.822431 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:53.822677 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:53.822677 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:53.822678 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:53.822845 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:53.823145 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:53.823151 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:53.823331 (+ 180us) client_negotiation.cc:769] Sending connection context
0808 07:07:53.823451 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 07:07:53.823655 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":106,"threads_started":1}
I20260808 07:07:53.824651 20554 heartbeater.cc:347] Connected to a master server at 127.9.94.62:38097
I20260808 07:07:53.824774 20554 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:53.825022 20554 heartbeater.cc:511] Master 127.9.94.62:38097 requested a full tablet report, sending...
I20260808 07:07:53.825539 20217 ts_manager.cc:194] Registered new tserver with Master: 36135804b7944c109e66a7dbe51c6ca7 (127.9.94.2:37981)
I20260808 07:07:53.825911 20217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:58771
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:07:53.853456 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:38097
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:53.944150 20560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:53.944386 20560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:53.944415 20560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:53.945748 20560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:53.945823 20560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:53.945856 20560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:07:53.947626 20560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:38097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:07:53.947917 20560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:53.948184 20560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:53.953934 20566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:53.954085 20568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:53.953958 20565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:53.954236 20560 server_base.cc:1034] running on GCE node
I20260808 07:07:53.954487 20560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:53.954810 20560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:53.956099 20560 hybrid_clock.cc:648] HybridClock initialized: now 1786172873956071 us; error 37 us; skew 500 ppm
Aug 08 07:07:53 dist-test-slave-77v9 krb5kdc[20170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172873, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:53.958930 20560 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:07:53.959501 20560 webserver.cc:460] Webserver started at http://127.9.94.3:39001/ using document root <none> and password file <none>
I20260808 07:07:53.959769 20560 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:53.959867 20560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:53.960028 20560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:07:53.961229 20560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "6f739ff8d51b4aff9866aa1c06fe6d09"
format_stamp: "Formatted at 2026-08-08 07:07:53 on dist-test-slave-77v9"
server_key: "7106ed103d8c6cdf8f8ea3de1cb47f36"
server_key_iv: "300fff8ac5eb431b981c9832cf28be95"
server_key_version: "encryptionkey@0"
I20260808 07:07:53.961617 20560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "6f739ff8d51b4aff9866aa1c06fe6d09"
format_stamp: "Formatted at 2026-08-08 07:07:53 on dist-test-slave-77v9"
server_key: "7106ed103d8c6cdf8f8ea3de1cb47f36"
server_key_iv: "300fff8ac5eb431b981c9832cf28be95"
server_key_version: "encryptionkey@0"
I20260808 07:07:53.963346 20560 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 07:07:53.964184 20575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:53.964382 20560 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:53.964494 20560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "6f739ff8d51b4aff9866aa1c06fe6d09"
format_stamp: "Formatted at 2026-08-08 07:07:53 on dist-test-slave-77v9"
server_key: "7106ed103d8c6cdf8f8ea3de1cb47f36"
server_key_iv: "300fff8ac5eb431b981c9832cf28be95"
server_key_version: "encryptionkey@0"
I20260808 07:07:53.964571 20560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:53.986761 20560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:53.989573 20560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:53.989763 20560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:53.990031 20560 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:53.990434 20560 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:53.990486 20560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:53.990526 20560 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:53.990556 20560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:53.996973 20560 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:35165
I20260808 07:07:53.997017 20690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:35165 every 8 connection(s)
I20260808 07:07:53.997354 20560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:07:53.999939 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 20560
I20260808 07:07:54.000066 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:07:54.000295 9592 external_mini_cluster.cc:1428] Setting key 5b2cc73a17a646f5a5a489f4369e551c
Aug 08 07:07:53 dist-test-slave-77v9 krb5kdc[20170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172873, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:07:54.007860 20257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:53.998190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:57555 (local address 127.9.94.62:38097)
0808 07:07:53.998239 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:53.998241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:53.998470 (+ 229us) server_negotiation.cc:407] Connection header received
0808 07:07:53.999080 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:53.999081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:53.999095 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:53.999161 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:54.000247 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.001030 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.002146 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.002366 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.002445 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:54.004940 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:54.004942 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:54.004942 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:54.004948 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:54.006426 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:54.006877 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:54.006879 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:54.006879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:54.006951 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:54.007232 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:54.007233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:54.007233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:54.007360 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:54.007420 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:54.007700 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 07:07:54.007787 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:07:54.007992 20693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:53.998158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:38097 (local address 127.9.94.3:57555)
0808 07:07:53.998347 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:53.998383 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:53.998931 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:53.999232 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:53.999236 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:53.999867 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:54.000086 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:54.000090 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.001128 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.001129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:54.002048 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:54.002051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.002451 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.002452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:54.002587 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:54.003191 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:54.003200 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:54.004757 (+ 1557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:54.006529 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:54.006535 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:54.006537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:54.006775 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:54.007057 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:54.007057 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:54.007058 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:54.007164 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:54.007432 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:54.007437 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:54.007556 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 07:07:54.007640 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 07:07:54.007767 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":92,"threads_started":1}
I20260808 07:07:54.008549 20691 heartbeater.cc:347] Connected to a master server at 127.9.94.62:38097
I20260808 07:07:54.008678 20691 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:54.008919 20691 heartbeater.cc:511] Master 127.9.94.62:38097 requested a full tablet report, sending...
I20260808 07:07:54.009402 20217 ts_manager.cc:194] Registered new tserver with Master: 6f739ff8d51b4aff9866aa1c06fe6d09 (127.9.94.3:35165)
I20260808 07:07:54.009819 20217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:57555
I20260808 07:07:54.012151 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:07:54.021023 20257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:54.013653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47698 (local address 127.9.94.62:38097)
0808 07:07:54.013855 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:54.013856 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:54.013865 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:07:54.013908 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:54.013909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:54.013917 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:54.013973 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:54.014553 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.015329 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.016169 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.016399 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.016486 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:54.017965 (+ 1479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:54.017966 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:54.017966 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:54.017972 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:54.019492 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:54.019926 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:54.019927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:54.019927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:54.020005 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:54.020284 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:54.020285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:54.020286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:54.020464 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:54.020556 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:54.020693 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 07:07:54.020763 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170}
I20260808 07:07:54.023453 20217 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47698:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:07:54.025240 20217 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:54.033043 20704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:54.028257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48266 (local address 127.9.94.2:37981)
0808 07:07:54.028465 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:54.028470 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:54.028485 (+ 15us) server_negotiation.cc:407] Connection header received
0808 07:07:54.028632 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:54.028635 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:54.028656 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:54.028719 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:54.029081 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.030410 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.031884 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.032549 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.032631 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:54.032709 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:54.032900 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 07:07:54.032945 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":90,"threads_started":1}
I20260808 07:07:54.033037 20703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:54.028137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:37981 (local address 127.0.0.1:48266)
0808 07:07:54.028359 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:54.028405 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:54.028483 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:54.028887 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:54.028890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:54.028893 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:54.028976 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:54.028979 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.030554 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.030555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:54.031767 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:54.031770 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.032646 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.032647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:54.032731 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:54.032746 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 07:07:54.032878 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 07:07:54.032940 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":70,"thread_start_us":71,"threads_started":1}
I20260808 07:07:54.033684 20707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:54.028330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51244 (local address 127.9.94.3:35165)
0808 07:07:54.028567 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:54.028571 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:54.028617 (+ 46us) server_negotiation.cc:407] Connection header received
0808 07:07:54.028734 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:54.028737 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:54.028755 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:54.028904 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:54.029204 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.030443 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.032321 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.033185 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.033266 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:54.033328 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:54.033553 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 07:07:54.033599 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":116,"threads_started":1}
I20260808 07:07:54.033735 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:54.028386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:43195 (local address 127.0.0.1:37022)
0808 07:07:54.028854 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:54.028866 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:54.028911 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:54.029304 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:54.029305 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:54.029307 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:54.029335 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:54.029336 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.030289 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.030291 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:54.032218 (+ 1927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:54.032221 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.033513 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.033514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:54.033576 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:54.033580 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:54.033629 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:07:54.033670 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":224,"thread_start_us":80,"threads_started":1}
I20260808 07:07:54.033951 20702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:54.028175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:35165 (local address 127.0.0.1:51244)
0808 07:07:54.028534 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:54.028547 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:54.028629 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:54.029047 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:54.029048 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:54.029050 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:54.029112 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:54.029113 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.030576 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.030578 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:54.032217 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:54.032221 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.033365 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.033366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:54.033442 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:54.033445 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:54.033807 (+ 362us) client_negotiation.cc:240] Negotiation successful
0808 07:07:54.033878 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":167,"thread_start_us":95,"threads_started":1}
I20260808 07:07:54.033896 20485 tablet_service.cc:1467] Processing CreateTablet for tablet 8afc92c6b32644ea9248d4efb86b0730 (DEFAULT_TABLE table=test-table [id=e4c08b5361f6491ba6d4e1de410ee32b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:54.034192 20709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:54.028630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37022 (local address 127.9.94.1:43195)
0808 07:07:54.029069 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:54.029073 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:54.029084 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:54.029126 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:54.029128 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:54.029145 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:54.029226 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:54.029417 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.030177 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.032333 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.033027 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.033094 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:54.033960 (+ 866us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:54.033989 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 07:07:54.034111 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":94,"threads_started":1}
I20260808 07:07:54.034302 20485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8afc92c6b32644ea9248d4efb86b0730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:54.034777 20347 tablet_service.cc:1467] Processing CreateTablet for tablet 8afc92c6b32644ea9248d4efb86b0730 (DEFAULT_TABLE table=test-table [id=e4c08b5361f6491ba6d4e1de410ee32b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:54.035111 20347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8afc92c6b32644ea9248d4efb86b0730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:54.037397 20710 tablet_bootstrap.cc:492] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7: Bootstrap starting.
I20260808 07:07:54.037532 20623 tablet_service.cc:1467] Processing CreateTablet for tablet 8afc92c6b32644ea9248d4efb86b0730 (DEFAULT_TABLE table=test-table [id=e4c08b5361f6491ba6d4e1de410ee32b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:54.037846 20623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8afc92c6b32644ea9248d4efb86b0730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:54.038307 20710 tablet_bootstrap.cc:654] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:54.038450 20711 tablet_bootstrap.cc:492] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4: Bootstrap starting.
I20260808 07:07:54.039080 20710 log.cc:824] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:54.039096 20711 tablet_bootstrap.cc:654] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:54.039698 20711 log.cc:824] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:54.040095 20710 tablet_bootstrap.cc:492] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7: No bootstrap required, opened a new log
I20260808 07:07:54.040182 20710 ts_tablet_manager.cc:1397] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:07:54.040516 20711 tablet_bootstrap.cc:492] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4: No bootstrap required, opened a new log
I20260808 07:07:54.040596 20711 ts_tablet_manager.cc:1397] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:07:54.041392 20714 tablet_bootstrap.cc:492] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09: Bootstrap starting.
I20260808 07:07:54.041949 20714 tablet_bootstrap.cc:654] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:54.042402 20714 log.cc:824] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:54.042443 20710 raft_consensus.cc:348] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36135804b7944c109e66a7dbe51c6ca7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37981 } } peers { permanent_uuid: "6f739ff8d51b4aff9866aa1c06fe6d09" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35165 } } peers { permanent_uuid: "25d402d2d47c4738807c7e3f1a6372c4" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43195 } }
I20260808 07:07:54.042634 20710 raft_consensus.cc:374] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:54.042690 20710 raft_consensus.cc:729] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36135804b7944c109e66a7dbe51c6ca7, State: Initialized, Role: FOLLOWER
I20260808 07:07:54.042727 20711 raft_consensus.cc:348] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36135804b7944c109e66a7dbe51c6ca7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37981 } } peers { permanent_uuid: "6f739ff8d51b4aff9866aa1c06fe6d09" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35165 } } peers { permanent_uuid: "25d402d2d47c4738807c7e3f1a6372c4" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43195 } }
I20260808 07:07:54.042840 20710 consensus_queue.cc:260] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36135804b7944c109e66a7dbe51c6ca7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37981 } } peers { permanent_uuid: "6f739ff8d51b4aff9866aa1c06fe6d09" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35165 } } peers { permanent_uuid: "25d402d2d47c4738807c7e3f1a6372c4" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43195 } }
I20260808 07:07:54.042898 20711 raft_consensus.cc:374] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:54.042938 20711 raft_consensus.cc:729] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d402d2d47c4738807c7e3f1a6372c4, State: Initialized, Role: FOLLOWER
I20260808 07:07:54.043097 20711 consensus_queue.cc:260] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36135804b7944c109e66a7dbe51c6ca7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37981 } } peers { permanent_uuid: "6f739ff8d51b4aff9866aa1c06fe6d09" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35165 } } peers { permanent_uuid: "25d402d2d47c4738807c7e3f1a6372c4" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43195 } }
I20260808 07:07:54.043164 20710 ts_tablet_manager.cc:1428] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:07:54.043298 20554 heartbeater.cc:503] Master 127.9.94.62:38097 was elected leader, sending a full tablet report...
I20260808 07:07:54.043327 20714 tablet_bootstrap.cc:492] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09: No bootstrap required, opened a new log
I20260808 07:07:54.043381 20714 ts_tablet_manager.cc:1397] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:07:54.043422 20414 heartbeater.cc:503] Master 127.9.94.62:38097 was elected leader, sending a full tablet report...
I20260808 07:07:54.043413 20711 ts_tablet_manager.cc:1428] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:07:54.045651 20714 raft_consensus.cc:348] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36135804b7944c109e66a7dbe51c6ca7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37981 } } peers { permanent_uuid: "6f739ff8d51b4aff9866aa1c06fe6d09" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35165 } } peers { permanent_uuid: "25d402d2d47c4738807c7e3f1a6372c4" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43195 } }
I20260808 07:07:54.045782 20714 raft_consensus.cc:374] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:54.045804 20714 raft_consensus.cc:729] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f739ff8d51b4aff9866aa1c06fe6d09, State: Initialized, Role: FOLLOWER
I20260808 07:07:54.045882 20714 consensus_queue.cc:260] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36135804b7944c109e66a7dbe51c6ca7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37981 } } peers { permanent_uuid: "6f739ff8d51b4aff9866aa1c06fe6d09" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35165 } } peers { permanent_uuid: "25d402d2d47c4738807c7e3f1a6372c4" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43195 } }
I20260808 07:07:54.046159 20714 ts_tablet_manager.cc:1428] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:07:54.046185 20691 heartbeater.cc:503] Master 127.9.94.62:38097 was elected leader, sending a full tablet report...
W20260808 07:07:54.063179 20556 tablet.cc:2369] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:07:54.072561 20719 raft_consensus.cc:482] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:54.072710 20719 raft_consensus.cc:504] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36135804b7944c109e66a7dbe51c6ca7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37981 } } peers { permanent_uuid: "6f739ff8d51b4aff9866aa1c06fe6d09" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35165 } } peers { permanent_uuid: "25d402d2d47c4738807c7e3f1a6372c4" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43195 } }
I20260808 07:07:54.073257 20719 leader_election.cc:288] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36135804b7944c109e66a7dbe51c6ca7 (127.9.94.2:37981), 25d402d2d47c4738807c7e3f1a6372c4 (127.9.94.1:43195)
I20260808 07:07:54.077008 20693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:54.073494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:37981 (local address 127.9.94.3:36945)
0808 07:07:54.073573 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:54.073587 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:54.073641 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:54.073858 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:54.073859 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:54.073862 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:54.073943 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:54.073945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.074744 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.074745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:54.075834 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:54.075837 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.076573 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.076574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:54.076671 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:54.076676 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:07:54.076848 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 07:07:54.076909 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":77}
I20260808 07:07:54.077025 20704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:54.073597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:36945 (local address 127.9.94.2:37981)
0808 07:07:54.073652 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:54.073655 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:54.073669 (+ 14us) server_negotiation.cc:407] Connection header received
0808 07:07:54.073705 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:54.073706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:54.073718 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:54.073809 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:54.074042 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.074639 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.075950 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.076466 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.076525 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:54.076544 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:54.076885 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 07:07:54.076950 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:07:54.077266 20709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:54.073608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:40397 (local address 127.9.94.1:43195)
0808 07:07:54.073656 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:54.073658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:54.073867 (+ 209us) server_negotiation.cc:407] Connection header received
0808 07:07:54.073936 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:54.073937 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:54.073951 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:54.074017 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:54.074213 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.074741 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.076254 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.076855 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.076931 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:54.076943 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:54.077122 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 07:07:54.077177 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:07:54.077277 20720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:54.073494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:43195 (local address 127.9.94.3:40397)
0808 07:07:54.073753 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:54.073765 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:54.073832 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:54.074041 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:54.074042 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:54.074043 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:54.074114 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:54.074115 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.074914 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.074915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:54.076117 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:54.076120 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.076942 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.076943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:54.077019 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:54.077023 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:07:54.077095 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 07:07:54.077140 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":48,"thread_start_us":150,"threads_started":1}
I20260808 07:07:54.077457 20505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8afc92c6b32644ea9248d4efb86b0730" candidate_uuid: "6f739ff8d51b4aff9866aa1c06fe6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36135804b7944c109e66a7dbe51c6ca7" is_pre_election: true
I20260808 07:07:54.077666 20505 raft_consensus.cc:2454] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f739ff8d51b4aff9866aa1c06fe6d09 in term 0.
I20260808 07:07:54.077702 20367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8afc92c6b32644ea9248d4efb86b0730" candidate_uuid: "6f739ff8d51b4aff9866aa1c06fe6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d402d2d47c4738807c7e3f1a6372c4" is_pre_election: true
I20260808 07:07:54.077848 20367 raft_consensus.cc:2454] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f739ff8d51b4aff9866aa1c06fe6d09 in term 0.
I20260808 07:07:54.077982 20577 leader_election.cc:302] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36135804b7944c109e66a7dbe51c6ca7, 6f739ff8d51b4aff9866aa1c06fe6d09; no voters:
I20260808 07:07:54.078137 20719 raft_consensus.cc:2781] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:54.078210 20719 raft_consensus.cc:482] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:54.078236 20719 raft_consensus.cc:3037] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:54.078997 20719 raft_consensus.cc:504] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36135804b7944c109e66a7dbe51c6ca7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37981 } } peers { permanent_uuid: "6f739ff8d51b4aff9866aa1c06fe6d09" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35165 } } peers { permanent_uuid: "25d402d2d47c4738807c7e3f1a6372c4" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43195 } }
I20260808 07:07:54.079147 20719 leader_election.cc:288] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [CANDIDATE]: Term 1 election: Requested vote from peers 36135804b7944c109e66a7dbe51c6ca7 (127.9.94.2:37981), 25d402d2d47c4738807c7e3f1a6372c4 (127.9.94.1:43195)
I20260808 07:07:54.079326 20367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8afc92c6b32644ea9248d4efb86b0730" candidate_uuid: "6f739ff8d51b4aff9866aa1c06fe6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d402d2d47c4738807c7e3f1a6372c4"
I20260808 07:07:54.079324 20505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8afc92c6b32644ea9248d4efb86b0730" candidate_uuid: "6f739ff8d51b4aff9866aa1c06fe6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36135804b7944c109e66a7dbe51c6ca7"
I20260808 07:07:54.079413 20505 raft_consensus.cc:3037] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:54.079417 20367 raft_consensus.cc:3037] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:54.080190 20505 raft_consensus.cc:2454] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f739ff8d51b4aff9866aa1c06fe6d09 in term 1.
I20260808 07:07:54.080195 20367 raft_consensus.cc:2454] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f739ff8d51b4aff9866aa1c06fe6d09 in term 1.
I20260808 07:07:54.080361 20577 leader_election.cc:302] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36135804b7944c109e66a7dbe51c6ca7, 6f739ff8d51b4aff9866aa1c06fe6d09; no voters:
I20260808 07:07:54.080487 20719 raft_consensus.cc:2781] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:54.080693 20719 raft_consensus.cc:686] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [term 1 LEADER]: Becoming Leader. State: Replica: 6f739ff8d51b4aff9866aa1c06fe6d09, State: Running, Role: LEADER
I20260808 07:07:54.080776 20719 consensus_queue.cc:237] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36135804b7944c109e66a7dbe51c6ca7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37981 } } peers { permanent_uuid: "6f739ff8d51b4aff9866aa1c06fe6d09" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35165 } } peers { permanent_uuid: "25d402d2d47c4738807c7e3f1a6372c4" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43195 } }
I20260808 07:07:54.081979 20217 catalog_manager.cc:5495] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f739ff8d51b4aff9866aa1c06fe6d09 (127.9.94.3). New cstate: current_term: 1 leader_uuid: "6f739ff8d51b4aff9866aa1c06fe6d09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36135804b7944c109e66a7dbe51c6ca7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f739ff8d51b4aff9866aa1c06fe6d09" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25d402d2d47c4738807c7e3f1a6372c4" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43195 } health_report { overall_health: UNKNOWN } } }
I20260808 07:07:54.092270 20707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:54.089440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51250 (local address 127.9.94.3:35165)
0808 07:07:54.089508 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:54.089511 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:54.089522 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:07:54.089620 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:54.089621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:54.089646 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:54.089735 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:54.089919 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.090459 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.091338 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:54.091566 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:54.091658 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:54.091850 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:54.091965 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:54.092066 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:54.092115 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 07:07:54.092140 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:07:54.094313 20505 raft_consensus.cc:1261] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7 [term 1 FOLLOWER]: Refusing update from remote peer 6f739ff8d51b4aff9866aa1c06fe6d09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:54.094318 20367 raft_consensus.cc:1261] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4 [term 1 FOLLOWER]: Refusing update from remote peer 6f739ff8d51b4aff9866aa1c06fe6d09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:54.094907 20719 consensus_queue.cc:1035] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36135804b7944c109e66a7dbe51c6ca7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:54.095086 20721 consensus_queue.cc:1035] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d402d2d47c4738807c7e3f1a6372c4" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:54.097798 20724 mvcc.cc:205] Tried to move back new op lower bound from 7316164092287246336 to 7316164092235833344. Current Snapshot: MvccSnapshot[applied={T|T < 7316164092287246336}]
I20260808 07:07:54.099213 20725 mvcc.cc:205] Tried to move back new op lower bound from 7316164092287246336 to 7316164092235833344. Current Snapshot: MvccSnapshot[applied={T|T < 7316164092287246336 or (T in {7316164092287246336})}]
I20260808 07:07:54.100611 20217 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:54.100874 20217 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:54.101872 20217 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9b0f865e41484e0fa9e6e350be698de9: Sending DeleteTablet for 3 replicas of tablet 8afc92c6b32644ea9248d4efb86b0730
I20260808 07:07:54.102275 20485 tablet_service.cc:1514] Processing DeleteTablet for tablet 8afc92c6b32644ea9248d4efb86b0730 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:54 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:48266
I20260808 07:07:54.102298 20623 tablet_service.cc:1514] Processing DeleteTablet for tablet 8afc92c6b32644ea9248d4efb86b0730 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:54 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:51244
I20260808 07:07:54.102541 20735 tablet_replica.cc:330] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7: stopping tablet replica
I20260808 07:07:54.102655 20735 raft_consensus.cc:2229] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:54.102692 20347 tablet_service.cc:1514] Processing DeleteTablet for tablet 8afc92c6b32644ea9248d4efb86b0730 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:54 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:37022
I20260808 07:07:54.102792 20735 raft_consensus.cc:2258] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:54.102991 20736 tablet_replica.cc:330] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4: stopping tablet replica
I20260808 07:07:54.103106 20736 raft_consensus.cc:2229] T 8afc92c6b32644ea9248d4efb86b0730 P 25d402d2d47c4738807c7e3f1a6372c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:54.103107 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 20281
I20260808 07:07:54.104885 20734 tablet_replica.cc:330] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09: stopping tablet replica
I20260808 07:07:54.105031 20734 raft_consensus.cc:2229] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:07:54.105161 20734 raft_consensus.cc:2258] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:54.106004 20734 ts_tablet_manager.cc:1905] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:54.108527 20734 ts_tablet_manager.cc:1918] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:54.108619 20734 log.cc:1196] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/8afc92c6b32644ea9248d4efb86b0730
I20260808 07:07:54.108997 20734 ts_tablet_manager.cc:1939] T 8afc92c6b32644ea9248d4efb86b0730 P 6f739ff8d51b4aff9866aa1c06fe6d09: Deleting consensus metadata
I20260808 07:07:54.109603 20204 catalog_manager.cc:4841] TS 6f739ff8d51b4aff9866aa1c06fe6d09 (127.9.94.3:35165): tablet 8afc92c6b32644ea9248d4efb86b0730 (table test-table [id=e4c08b5361f6491ba6d4e1de410ee32b]) successfully deleted
I20260808 07:07:54.113478 20735 ts_tablet_manager.cc:1905] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:54.115674 20735 ts_tablet_manager.cc:1918] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:54.115772 20735 log.cc:1196] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/8afc92c6b32644ea9248d4efb86b0730
I20260808 07:07:54.116063 20735 ts_tablet_manager.cc:1939] T 8afc92c6b32644ea9248d4efb86b0730 P 36135804b7944c109e66a7dbe51c6ca7: Deleting consensus metadata
I20260808 07:07:54.116631 20202 catalog_manager.cc:4841] TS 36135804b7944c109e66a7dbe51c6ca7 (127.9.94.2:37981): tablet 8afc92c6b32644ea9248d4efb86b0730 (table test-table [id=e4c08b5361f6491ba6d4e1de410ee32b]) successfully deleted
W20260808 07:07:54.117483 20204 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:43195 (error 108)
I20260808 07:07:54.118111 20703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:54.117966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:43195 (local address 127.0.0.1:37032)
0808 07:07:54.118027 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:54.118067 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:43195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 07:07:54.118274 20204 catalog_manager.cc:4584] TS 25d402d2d47c4738807c7e3f1a6372c4 (127.9.94.1:43195): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8afc92c6b32644ea9248d4efb86b0730: Network error: Client connection negotiation failed: client connection to 127.9.94.1:43195: connect: Connection refused (error 111)
I20260808 07:07:54.118409 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 20420
I20260808 07:07:54.125507 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 20560
I20260808 07:07:54.132465 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 20184
2026-08-08T07:07:54Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2131 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:07:54 dist-test-slave-77v9 krb5kdc[20740](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:07:54 dist-test-slave-77v9 krb5kdc[20740](info): set up 2 sockets
Aug 08 07:07:54 dist-test-slave-77v9 krb5kdc[20740](info): commencing operation
krb5kdc: starting...
W20260808 07:07:55.291486 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:07:55 dist-test-slave-77v9 krb5kdc[20740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:07:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:55Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.9.94.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.9.94.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/rangeradmin_127.9.94.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/rangeradmin_127.9.94.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.9.94.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.9.94.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/rangerlookup_127.9.94.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/rangerlookup_127.9.94.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.94.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.9.94.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/HTTP_127.9.94.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/HTTP_127.9.94.20@KRBTEST.COM.keytab.
I20260808 07:07:55.514411 9592 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskfmG05D/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/postgres -l logfile start
2026-08-08 07:07:58.811 UTC [20770] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 07:07:58.812 UTC [20770] LOG: listening on IPv4 address "127.9.94.20", port 47033
2026-08-08 07:07:58.818 UTC [20770] LOG: listening on Unix socket "/tmp/.s.PGSQL.47033"
2026-08-08 07:07:58.860 UTC [20773] LOG: database system was shut down at 2026-08-08 07:07:56 UTC
2026-08-08 07:07:58.865 UTC [20770] LOG: database system is ready to accept connections
I20260808 07:07:59.886373 9592 mini_postgres.cc:96] Postgres bound to 47033
2026-08-08 07:07:59.896 UTC [20781] FATAL: database "slave" does not exist
127.9.94.20:47033 - accepting connections
I20260808 07:07:59.897516 9592 mini_ranger.cc:161] Starting Ranger...
I20260808 07:07:59.918138 9592 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 07:08:00.642868 9592 mini_ranger.cc:87] Created ranger Postgres database
I20260808 07:08:00.642966 9592 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-admin
2026-08-08 07:08:01,015 [I] DB FLAVOR :POSTGRES
2026-08-08 07:08:01,016 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 07:08:01,016 [I] Checking connection..
2026-08-08 07:08:01,016 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 07:08:01,328 [I] Checking connection passed.
2026-08-08 07:08:01,329 [I] --------- Verifying version history table ---------
2026-08-08 07:08:01,329 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:08:01,641 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 07:08:01,641 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:08:01,937 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 07:08:01,938 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 07:08:01,938 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 07:08:02.248 UTC [20850] WARNING: there is no transaction in progress
2026-08-08 07:08:02,257 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 07:08:02,258 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:08:02,565 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 07:08:02,565 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 07:08:02,565 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 07:08:02,870 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 07:08:03,161 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-77v9.c.gcp-upstream.internal','N') ;"
2026-08-08 07:08:03,465 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 07:08:03,770 [I] Table x_portal_user does not exist in database ranger
2026-08-08 07:08:03,770 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 07:08:04,057 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 07:08:04,058 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 07:08:04,322 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 07:08:04,602 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 07:08:04,602 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 07:08:05.823 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:05.845 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:05.867 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:05.887 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:05.909 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:05.932 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:06.011 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:06.022 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:06.042 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:06.056 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:06.070 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:06.088 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:06.101 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:06.110 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:06.120 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:06.130 UTC [20961] WARNING: there is no transaction in progress
2026-08-08 07:08:07,104 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 07:08:07,105 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 07:08:07,385 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 07:08:07,386 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 07:08:07,690 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 07:08:07,690 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 07:08:07,964 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 07:08:07,965 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 07:08:08,237 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 07:08:08,505 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-77v9.c.gcp-upstream.internal';"
2026-08-08 07:08:08,781 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 07:08:08,781 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 07:08:09,078 [I] DB_PATCHES have already been applied
I20260808 07:08:09.085680 9592 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-admin:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskfmG05D/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 07:08:09.085762 9592 mini_ranger.cc:193] Using host: 127.9.94.20
I20260808 07:08:09.090307 9592 mini_ranger.cc:227] Ranger admin URL: http://127.9.94.20:37707
Aug 08, 2026 7:08:09 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 7:08:09 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 7:08:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 7:08:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 7:08:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 7:08:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 7:08:10 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 07:08:10.353924 9592 mini_ranger.cc:160] Time spent starting Ranger: real 10.456s user 0.003s sys 0.010s
Aug 08, 2026 7:08:34 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 7:08:34 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 7:08:34 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 7:08:34 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 7:08:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 7:08:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 7:08:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 7:08:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 7:08:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 7:08:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 7:08:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 7:08:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 7:08:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 7:08:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 7:08:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 7:08:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 7:08:34 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 7:08:35 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 07:08:36.012115 9592 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.9.94.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.9.94.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/rangerkms_127.9.94.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/rangerkms_127.9.94.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.94.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.9.94.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.94.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/HTTP_127.9.94.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.94.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/HTTP_127.9.94.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 07:08:36 dist-test-slave-77v9 krb5kdc[20740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172916, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 07:08:36.118368 9592 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 07:08:36.132802 9592 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 07:08:37.362887 9592 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 07:08:37.363024 9592 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-kms
I20260808 07:08:37.363045 9592 mini_ranger_kms.cc:227] Using postgres at 127.9.94.20:47033
2026-08-08 07:08:38,233 [I] DB FLAVOR :POSTGRES
2026-08-08 07:08:38,233 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 07:08:38,233 [I] Checking connection
2026-08-08 07:08:38,233 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 07:08:38,517 [I] connection success
2026-08-08 07:08:38,517 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 07:08:38,517 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 07:08:38,517 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 07:08:38,818 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 07:08:38,818 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 07:08:38,819 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 07:08:38,819 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:47033/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 07:08:39,127 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 07:08:39.656999 9592 mini_ranger_kms.cc:310] Created kms service
I20260808 07:08:39.895812 9592 mini_ranger_kms.cc:326] Created kudu user
I20260808 07:08:39.947117 9592 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 07:08:39 dist-test-slave-77v9 krb5kdc[20740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172916, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
I20260808 07:08:40.392830 9592 mini_ranger_kms.cc:384] Added ranger policy
I20260808 07:08:40.392977 9592 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-kms:/tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 07:08:40.393002 9592 mini_ranger_kms.cc:240] Using host: 127.9.94.20
I20260808 07:08:40.397284 9592 mini_ranger_kms.cc:276] Ranger KMS PID: 21149
I20260808 07:08:40.397418 9592 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.9.94.20:37889
Aug 08, 2026 7:08:41 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 7:08:41 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 7:08:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 7:08:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 7:08:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 7:08:42 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 07:08:42.891741 9592 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.773s user 0.000s sys 0.833s
I20260808 07:08:42.891891 9592 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 07:08:42.892000 9592 mini_ranger_kms.cc:401] 127.9.94.20:37889/kms/v1/keys
Aug 08 07:08:43 dist-test-slave-77v9 krb5kdc[20740](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786172923, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.94.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 07:08:43 dist-test-slave-77v9 krb5kdc[20740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172923, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.94.20@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
Aug 08 07:08:44 dist-test-slave-77v9 krb5kdc[20740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172923, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.94.20@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
Aug 08 07:08:47 dist-test-slave-77v9 krb5kdc[20740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:08:47.294603 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:35353
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:35353
--ranger_config_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.94.20:37889/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:47.432508 21201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:47.433007 21201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:47.433094 21201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:47.435464 21201 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:08:47.435598 21201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:47.435654 21201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:47.435703 21201 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:08:47.435752 21201 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:08:47.438957 21201 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/wal
--ranger_kms_url=127.9.94.20:37889/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:35353
--ranger_config_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:35353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:08:47.439495 21201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:47.439850 21201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:47.448223 21207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:47.448314 21209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:47.448292 21206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:47.448302 21201 server_base.cc:1034] running on GCE node
I20260808 07:08:47.448987 21201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:47.449345 21201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:47.450562 21201 hybrid_clock.cc:648] HybridClock initialized: now 1786172927450537 us; error 44 us; skew 500 ppm
Aug 08 07:08:47 dist-test-slave-77v9 krb5kdc[20740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172927, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:47.454421 21201 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:08:47.455062 21201 webserver.cc:460] Webserver started at http://127.9.94.62:35101/ using document root <none> and password file <none>
I20260808 07:08:47.455307 21201 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:47.455374 21201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:47.455598 21201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:08:47 dist-test-slave-77v9 krb5kdc[20740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172927, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
I20260808 07:08:47.556486 21201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "74d5ffca707c4a71b05824d0a4498933"
format_stamp: "Formatted at 2026-08-08 07:08:47 on dist-test-slave-77v9"
server_key: "fce027edaebbe62448a3ce387412778d"
server_key_iv: "891f02b2950d97ace9e11885fc746da9"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:47.557089 21201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "74d5ffca707c4a71b05824d0a4498933"
format_stamp: "Formatted at 2026-08-08 07:08:47 on dist-test-slave-77v9"
server_key: "fce027edaebbe62448a3ce387412778d"
server_key_iv: "891f02b2950d97ace9e11885fc746da9"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:47.560084 21201 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260808 07:08:47.577451 21216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:47.577632 21201 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:08:47.577719 21201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "74d5ffca707c4a71b05824d0a4498933"
format_stamp: "Formatted at 2026-08-08 07:08:47 on dist-test-slave-77v9"
server_key: "fce027edaebbe62448a3ce387412778d"
server_key_iv: "891f02b2950d97ace9e11885fc746da9"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:47.577822 21201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:47.593231 21201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:47.595996 21201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:47.596199 21201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:47.609658 21201 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:35353
I20260808 07:08:47.609895 21268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:35353 every 8 connection(s)
I20260808 07:08:47.610327 21201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:08:47.611407 21269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:47.614931 21269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933: Bootstrap starting.
I20260808 07:08:47.615373 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 21201
I20260808 07:08:47.615501 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:08:47.615708 9592 external_mini_cluster.cc:1428] Setting key d6ca0dc78491cc0e6289e4125e385da7
I20260808 07:08:47.616425 21269 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:47.617404 21269 log.cc:824] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:47.618564 21269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933: No bootstrap required, opened a new log
I20260808 07:08:47.621932 21269 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74d5ffca707c4a71b05824d0a4498933" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35353 } }
I20260808 07:08:47.622145 21269 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:47.622198 21269 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d5ffca707c4a71b05824d0a4498933, State: Initialized, Role: FOLLOWER
I20260808 07:08:47.622337 21269 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74d5ffca707c4a71b05824d0a4498933" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35353 } }
I20260808 07:08:47.622437 21269 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:08:47.622478 21269 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:08:47.622517 21269 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:47.623355 21269 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74d5ffca707c4a71b05824d0a4498933" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35353 } }
I20260808 07:08:47.623471 21269 leader_election.cc:302] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74d5ffca707c4a71b05824d0a4498933; no voters:
I20260808 07:08:47.623660 21269 leader_election.cc:288] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:08:47.623852 21274 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:08:47.624567 21274 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [term 1 LEADER]: Becoming Leader. State: Replica: 74d5ffca707c4a71b05824d0a4498933, State: Running, Role: LEADER
I20260808 07:08:47.623950 21269 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:08:47.626281 21274 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74d5ffca707c4a71b05824d0a4498933" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35353 } }
Aug 08 07:08:47 dist-test-slave-77v9 krb5kdc[20740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:08:47.627591 21275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74d5ffca707c4a71b05824d0a4498933" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74d5ffca707c4a71b05824d0a4498933" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35353 } } }
I20260808 07:08:47.627708 21275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:47.628254 21283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:08:47.628840 21276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74d5ffca707c4a71b05824d0a4498933. Latest consensus state: current_term: 1 leader_uuid: "74d5ffca707c4a71b05824d0a4498933" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74d5ffca707c4a71b05824d0a4498933" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35353 } } }
I20260808 07:08:47.629015 21276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933 [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:47.630076 21283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:08:47.630888 21269 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 07:08:47.642334 21272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:47.616616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36660 (local address 127.9.94.62:35353)
0808 07:08:47.617192 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:47.617212 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:47.617287 (+ 75us) server_negotiation.cc:407] Connection header received
0808 07:08:47.618267 (+ 980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:47.618276 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:47.618344 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:47.618505 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:47.619588 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:47.621954 (+ 2366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:47.623139 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:47.623889 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:47.624002 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:47.628695 (+ 4693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:47.628714 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:47.628714 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:47.628730 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:47.631951 (+ 3221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:47.633795 (+ 1844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:47.634004 (+ 209us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:47.634004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:47.635330 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:47.635728 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:47.635729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:47.635729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:47.637632 (+ 1903us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:47.639474 (+ 1842us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:47.639764 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 07:08:47.641478 (+ 1714us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":314,"threads_started":1}
I20260808 07:08:47.650841 21283 catalog_manager.cc:1347] Generated new cluster ID: 9e1d35233cd64873945557229f57539b
I20260808 07:08:47.650940 21283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:08:47.699059 21283 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:08:47.700348 21283 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:08:47.709954 21283 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933: Generated new TSK 0
I20260808 07:08:47.710479 21283 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:08:48.804560 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.94.20:37889/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:35353
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:48.956650 21316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:48.956974 21316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:48.957019 21316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:48.959054 21316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:48.959141 21316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:48.959188 21316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:08:48.961556 21316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.9.94.20:37889/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:35353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:08:48.961845 21316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:48.962132 21316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:48.971256 21325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:48.971306 21316 server_base.cc:1034] running on GCE node
W20260808 07:08:48.971333 21323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:48.971269 21321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:48.971825 21316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:48.972291 21316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:48.973564 21316 hybrid_clock.cc:648] HybridClock initialized: now 1786172928973527 us; error 46 us; skew 500 ppm
Aug 08 07:08:48 dist-test-slave-77v9 krb5kdc[20740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172928, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:48.977962 21316 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:08:48.978572 21316 webserver.cc:460] Webserver started at http://127.9.94.1:32939/ using document root <none> and password file <none>
I20260808 07:08:48.978885 21316 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:48.978981 21316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:48.979166 21316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:08:48 dist-test-slave-77v9 krb5kdc[20740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172928, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
I20260808 07:08:48.996302 21316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "94ecd1505fbe435da8f99e4e06674d9c"
format_stamp: "Formatted at 2026-08-08 07:08:48 on dist-test-slave-77v9"
server_key: "c77ff9807f7cfb3d472153024cb5103b"
server_key_iv: "4756999e7830af1141e6507ea6329bbe"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:48.997164 21316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "94ecd1505fbe435da8f99e4e06674d9c"
format_stamp: "Formatted at 2026-08-08 07:08:48 on dist-test-slave-77v9"
server_key: "c77ff9807f7cfb3d472153024cb5103b"
server_key_iv: "4756999e7830af1141e6507ea6329bbe"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:48.999552 21316 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260808 07:08:49.016707 21332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:49.016937 21316 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:08:49.017086 21316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "94ecd1505fbe435da8f99e4e06674d9c"
format_stamp: "Formatted at 2026-08-08 07:08:48 on dist-test-slave-77v9"
server_key: "c77ff9807f7cfb3d472153024cb5103b"
server_key_iv: "4756999e7830af1141e6507ea6329bbe"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:49.017212 21316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:49.036545 21316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:49.039911 21316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:49.040198 21316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:49.040639 21316 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:49.041080 21316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:49.041124 21316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:49.041163 21316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:49.041190 21316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:49.060170 21316 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:36773
I20260808 07:08:49.060992 21316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:08:49.063714 21452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:36773 every 8 connection(s)
I20260808 07:08:49.068944 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 21316
I20260808 07:08:49.069120 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:08:49.069383 9592 external_mini_cluster.cc:1428] Setting key ed55d3aa5556d1176d0b7928669f3a11
Aug 08 07:08:49 dist-test-slave-77v9 krb5kdc[20740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172928, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:08:49.078794 21456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.064579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35353 (local address 127.9.94.1:53023)
0808 07:08:49.065254 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:49.065301 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:49.066473 (+ 1172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:49.066927 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:49.066931 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:49.067461 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:49.067947 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.067953 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.069043 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.069045 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.070474 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.070477 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.071011 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.071012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.071226 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.071989 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:49.071999 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:49.074152 (+ 2153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:49.076871 (+ 2719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:49.076881 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:49.076884 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:49.077220 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:49.077470 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:49.077471 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:49.077471 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:49.077612 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:49.077923 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:49.077930 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:49.078199 (+ 269us) client_negotiation.cc:769] Sending connection context
0808 07:08:49.078302 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 07:08:49.078481 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":254,"threads_started":1}
I20260808 07:08:49.079618 21455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.064606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:53023 (local address 127.9.94.62:35353)
0808 07:08:49.065885 (+ 1279us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.065888 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.065902 (+ 14us) server_negotiation.cc:407] Connection header received
0808 07:08:49.066663 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.066664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.066678 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.066812 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:49.068078 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.068933 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.070575 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.070876 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.070939 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.074292 (+ 3353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:49.074294 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:49.074294 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:49.074302 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:49.076712 (+ 2410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:49.077322 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:49.077324 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:49.077324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:49.077395 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:49.077683 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:49.077684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:49.077684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:49.077829 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:49.079378 (+ 1549us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:49.079424 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 07:08:49.079516 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1220,"thread_start_us":178,"threads_started":1}
I20260808 07:08:49.080416 21453 heartbeater.cc:347] Connected to a master server at 127.9.94.62:35353
I20260808 07:08:49.080549 21453 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:49.080932 21453 heartbeater.cc:511] Master 127.9.94.62:35353 requested a full tablet report, sending...
I20260808 07:08:49.081641 21233 ts_manager.cc:194] Registered new tserver with Master: 94ecd1505fbe435da8f99e4e06674d9c (127.9.94.1:36773)
I20260808 07:08:49.082701 21233 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:53023
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:08:49.117864 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.94.20:37889/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:35353
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:49.299008 21459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:49.299602 21459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:49.299747 21459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:49.302512 21459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:49.302682 21459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:49.302816 21459 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:08:49.306082 21459 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.9.94.20:37889/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:35353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:08:49.306843 21459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:49.307382 21459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:49.322034 21471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:49.322099 21468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:49.323405 21467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:49.324986 21459 server_base.cc:1034] running on GCE node
I20260808 07:08:49.325353 21459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:49.325750 21459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:49.326936 21459 hybrid_clock.cc:648] HybridClock initialized: now 1786172929326898 us; error 52 us; skew 500 ppm
Aug 08 07:08:49 dist-test-slave-77v9 krb5kdc[20740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172929, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:49.332710 21459 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:08:49.333773 21459 webserver.cc:460] Webserver started at http://127.9.94.2:34373/ using document root <none> and password file <none>
I20260808 07:08:49.334216 21459 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:49.334379 21459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:49.334586 21459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:08:49 dist-test-slave-77v9 krb5kdc[20740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172929, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
I20260808 07:08:49.361049 21459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "5754582afb304e7d9c9ca408888a9812"
format_stamp: "Formatted at 2026-08-08 07:08:49 on dist-test-slave-77v9"
server_key: "c6ab0f6a46d9ec50d10f02202f0853d1"
server_key_iv: "3d4c48e14591e47acb7cbe27b920ee50"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:49.361922 21459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "5754582afb304e7d9c9ca408888a9812"
format_stamp: "Formatted at 2026-08-08 07:08:49 on dist-test-slave-77v9"
server_key: "c6ab0f6a46d9ec50d10f02202f0853d1"
server_key_iv: "3d4c48e14591e47acb7cbe27b920ee50"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:49.367539 21459 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.001s
I20260808 07:08:49.384346 21478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:49.384562 21459 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:49.384658 21459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "5754582afb304e7d9c9ca408888a9812"
format_stamp: "Formatted at 2026-08-08 07:08:49 on dist-test-slave-77v9"
server_key: "c6ab0f6a46d9ec50d10f02202f0853d1"
server_key_iv: "3d4c48e14591e47acb7cbe27b920ee50"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:49.384781 21459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 08 07:08:49 dist-test-slave-77v9 krb5kdc[20740](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786172929, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:49.440315 21459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:49.444715 21459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:49.444959 21459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:49.445452 21459 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:49.446064 21459 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:49.446138 21459 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:49.446187 21459 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:49.446216 21459 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:49.467723 21459 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:34703
I20260808 07:08:49.468309 21459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:08:49.475399 21595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:34703 every 8 connection(s)
I20260808 07:08:49.476107 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 21459
I20260808 07:08:49.476233 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:08:49.476465 9592 external_mini_cluster.cc:1428] Setting key ec8125406cf3c67afb25280a052279fb
Aug 08 07:08:49 dist-test-slave-77v9 krb5kdc[20740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172929, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
I20260808 07:08:49.495554 21455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.475793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:40099 (local address 127.9.94.62:35353)
0808 07:08:49.475849 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.475852 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.479430 (+ 3578us) server_negotiation.cc:407] Connection header received
0808 07:08:49.480270 (+ 840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.480271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.480285 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.480320 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:49.481638 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.482537 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.484395 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.484935 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.484999 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.491420 (+ 6421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:49.491423 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:49.491423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:49.491432 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:49.493519 (+ 2087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:49.494159 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:49.494161 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:49.494162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:49.494231 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:49.494573 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:49.494574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:49.494575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:49.494735 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:49.494796 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:49.495333 (+ 537us) server_negotiation.cc:299] Negotiation successful
0808 07:08:49.495444 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
I20260808 07:08:49.496256 21599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.475638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35353 (local address 127.9.94.2:40099)
0808 07:08:49.479227 (+ 3589us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:49.479297 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:49.480123 (+ 826us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:49.480540 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:49.480544 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:49.481147 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:49.481498 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.481506 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.482702 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.482703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.484285 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.484289 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.485112 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.485113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.485283 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.489069 (+ 3786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:49.489081 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:49.491223 (+ 2142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:49.493644 (+ 2421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:49.493655 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:49.493658 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:49.494015 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:49.494325 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:49.494326 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:49.494327 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:49.494486 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:49.494835 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:49.494842 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:49.495131 (+ 289us) client_negotiation.cc:769] Sending connection context
0808 07:08:49.495715 (+ 584us) client_negotiation.cc:240] Negotiation successful
0808 07:08:49.495911 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3524,"thread_start_us":328,"threads_started":1}
I20260808 07:08:49.496791 21596 heartbeater.cc:347] Connected to a master server at 127.9.94.62:35353
I20260808 07:08:49.496937 21596 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:49.497143 21596 heartbeater.cc:511] Master 127.9.94.62:35353 requested a full tablet report, sending...
I20260808 07:08:49.499943 21233 ts_manager.cc:194] Registered new tserver with Master: 5754582afb304e7d9c9ca408888a9812 (127.9.94.2:34703)
I20260808 07:08:49.500527 21233 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:40099
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:08:49.524688 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.94.20:37889/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:35353
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:49.736990 21603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:49.737375 21603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:49.737425 21603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:49.739967 21603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:49.740056 21603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:49.740111 21603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:08:49.743505 21603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.9.94.20:37889/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:35353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:08:49.743884 21603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:49.744272 21603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:49.756953 21611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:49.757401 21609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:49.758805 21608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:49.759479 21603 server_base.cc:1034] running on GCE node
I20260808 07:08:49.759874 21603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:49.760300 21603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:49.761530 21603 hybrid_clock.cc:648] HybridClock initialized: now 1786172929761499 us; error 45 us; skew 500 ppm
Aug 08 07:08:49 dist-test-slave-77v9 krb5kdc[20740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172929, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:49.767220 21603 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:08:49.768090 21603 webserver.cc:460] Webserver started at http://127.9.94.3:40523/ using document root <none> and password file <none>
I20260808 07:08:49.768483 21603 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:49.768584 21603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:49.768780 21603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:08:49 dist-test-slave-77v9 krb5kdc[20740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172929, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
I20260808 07:08:49.800702 21603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "17561acd711442bb8e9c80cf20a7a58c"
format_stamp: "Formatted at 2026-08-08 07:08:49 on dist-test-slave-77v9"
server_key: "964d812290a0e619c8c819927182bf95"
server_key_iv: "28484f4e21bd7e664d7c353243a2be48"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:49.801798 21603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "17561acd711442bb8e9c80cf20a7a58c"
format_stamp: "Formatted at 2026-08-08 07:08:49 on dist-test-slave-77v9"
server_key: "964d812290a0e619c8c819927182bf95"
server_key_iv: "28484f4e21bd7e664d7c353243a2be48"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:49.806149 21603 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 07:08:49.826644 21618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:49.827059 21603 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 07:08:49.827214 21603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "17561acd711442bb8e9c80cf20a7a58c"
format_stamp: "Formatted at 2026-08-08 07:08:49 on dist-test-slave-77v9"
server_key: "964d812290a0e619c8c819927182bf95"
server_key_iv: "28484f4e21bd7e664d7c353243a2be48"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:49.827349 21603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:49.854297 21603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:49.857498 21603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:49.857789 21603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:49.858188 21603 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:49.858721 21603 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:49.858783 21603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:49.858829 21603 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:49.858872 21603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:49.889012 21603 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:36487
I20260808 07:08:49.889544 21603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:08:49.890417 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 21603
I20260808 07:08:49.890527 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:08:49.890713 9592 external_mini_cluster.cc:1428] Setting key bc67ab08ba8acc33e2e233b85ba895bf
I20260808 07:08:49.894918 21735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:36487 every 8 connection(s)
Aug 08 07:08:49 dist-test-slave-77v9 krb5kdc[20740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172929, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:08:49.908447 21455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.896441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:39349 (local address 127.9.94.62:35353)
0808 07:08:49.896525 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.896528 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.896793 (+ 265us) server_negotiation.cc:407] Connection header received
0808 07:08:49.897863 (+ 1070us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.897864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.897879 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.897936 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:49.898968 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.899537 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.900777 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.901108 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.901183 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.904399 (+ 3216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:49.904401 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:49.904401 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:49.904417 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:49.906739 (+ 2322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:49.907292 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:49.907294 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:49.907294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:49.907357 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:49.907647 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:49.907648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:49.907648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:49.907779 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:49.907859 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:49.908250 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 07:08:49.908349 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 07:08:49.908838 21738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.895989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35353 (local address 127.9.94.3:39349)
0808 07:08:49.896635 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:49.896675 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:49.897720 (+ 1045us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:49.898016 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:49.898021 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:49.898516 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:49.898860 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.898865 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.899651 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.899652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.900675 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.900677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.901282 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.901283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.901519 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.902325 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:49.902337 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:49.904253 (+ 1916us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:49.906899 (+ 2646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:49.906907 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:49.906910 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:49.907181 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:49.907439 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:49.907440 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:49.907440 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:49.907568 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:49.907848 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:49.907855 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:49.908093 (+ 238us) client_negotiation.cc:769] Sending connection context
0808 07:08:49.908215 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 07:08:49.908397 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":248,"threads_started":1}
I20260808 07:08:49.909417 21736 heartbeater.cc:347] Connected to a master server at 127.9.94.62:35353
I20260808 07:08:49.909536 21736 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:49.909739 21736 heartbeater.cc:511] Master 127.9.94.62:35353 requested a full tablet report, sending...
I20260808 07:08:49.910166 21233 ts_manager.cc:194] Registered new tserver with Master: 17561acd711442bb8e9c80cf20a7a58c (127.9.94.3:36487)
I20260808 07:08:49.910552 21233 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:39349
I20260808 07:08:49.914052 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:08:49.925283 21455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.916070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51634 (local address 127.9.94.62:35353)
0808 07:08:49.916119 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.916121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.916962 (+ 841us) server_negotiation.cc:407] Connection header received
0808 07:08:49.917077 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.917078 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.917089 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.917122 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:49.918144 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.918991 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.920242 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.920469 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.920568 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.922124 (+ 1556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:49.922125 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:49.922126 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:49.922134 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:49.923743 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:49.924216 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:49.924218 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:49.924218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:49.924290 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:49.924575 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:49.924576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:49.924576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:49.924706 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:49.924862 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:49.924979 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 07:08:49.925069 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:08:49.927304 21233 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51634:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:08:49.929764 21233 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:08:49.942252 21752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.933113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:34703 (local address 127.0.0.1:57702)
0808 07:08:49.934781 (+ 1668us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:49.934791 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:49.934857 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:49.935347 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:49.935348 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:49.935349 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:49.935487 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.935489 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.937829 (+ 2340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.937830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.939792 (+ 1962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.939794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.941792 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.941793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.941986 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.942005 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 07:08:49.942076 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 07:08:49.942143 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1627,"mutex_wait_us":2,"thread_start_us":183,"threads_started":1}
I20260808 07:08:49.943589 21753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.934104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57702 (local address 127.9.94.2:34703)
0808 07:08:49.935020 (+ 916us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.935025 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.935036 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:08:49.935109 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.935111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.935130 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.935203 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:49.935576 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.937728 (+ 2152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.940044 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.941251 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.941345 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.943339 (+ 1994us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:49.943373 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 07:08:49.943444 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":883,"thread_start_us":79,"threads_started":1}
I20260808 07:08:49.944585 21519 tablet_service.cc:1467] Processing CreateTablet for tablet 1638d93a45d24506aff9b0da28c8be94 (DEFAULT_TABLE table=test-table [id=dfe99798cbf34ea189a424294a5a9e6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:49.945039 21519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1638d93a45d24506aff9b0da28c8be94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:49.950034 21755 tablet_bootstrap.cc:492] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812: Bootstrap starting.
I20260808 07:08:49.950944 21749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.933113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:36773 (local address 127.0.0.1:43348)
0808 07:08:49.934636 (+ 1523us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:49.934685 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:49.934802 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:49.935305 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:49.935309 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:49.935312 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:49.935417 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.935420 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.942201 (+ 6781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.942202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.943877 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.943881 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.950572 (+ 6691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.950573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.950693 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.950697 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:08:49.950753 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 07:08:49.950828 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1448,"thread_start_us":187,"threads_started":1}
I20260808 07:08:49.951177 21754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.934105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59958 (local address 127.9.94.3:36487)
0808 07:08:49.934503 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.934509 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.936907 (+ 2398us) server_negotiation.cc:407] Connection header received
0808 07:08:49.936992 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.936994 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.937011 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.937095 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:49.937459 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.938826 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.940502 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.941597 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.941674 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.941876 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:49.950928 (+ 9052us) server_negotiation.cc:299] Negotiation successful
0808 07:08:49.950995 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":159,"threads_started":1}
I20260808 07:08:49.951437 21750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.933480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:36487 (local address 127.0.0.1:59958)
0808 07:08:49.936679 (+ 3199us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:49.936690 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:49.936744 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:49.937233 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:49.937234 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:49.937236 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:49.937369 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.937371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.938934 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.938935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.940246 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.940249 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.950691 (+ 10442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.950692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.950812 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.950816 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:08:49.951293 (+ 477us) client_negotiation.cc:240] Negotiation successful
0808 07:08:49.951358 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3157,"thread_start_us":263,"threads_started":1}
I20260808 07:08:49.952574 21667 tablet_service.cc:1467] Processing CreateTablet for tablet 1638d93a45d24506aff9b0da28c8be94 (DEFAULT_TABLE table=test-table [id=dfe99798cbf34ea189a424294a5a9e6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:49.953094 21751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.933513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43348 (local address 127.9.94.1:36773)
0808 07:08:49.935008 (+ 1495us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.935013 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.935026 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:08:49.935066 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.935068 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.935103 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.935189 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:49.935542 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.942102 (+ 6560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.944005 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.950484 (+ 6479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.950574 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.950633 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:49.952950 (+ 2317us) server_negotiation.cc:299] Negotiation successful
0808 07:08:49.953008 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1460,"thread_start_us":183,"threads_started":1}
I20260808 07:08:49.953049 21667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1638d93a45d24506aff9b0da28c8be94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:49.953965 21382 tablet_service.cc:1467] Processing CreateTablet for tablet 1638d93a45d24506aff9b0da28c8be94 (DEFAULT_TABLE table=test-table [id=dfe99798cbf34ea189a424294a5a9e6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:49.954340 21382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1638d93a45d24506aff9b0da28c8be94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:49.959894 21756 tablet_bootstrap.cc:492] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c: Bootstrap starting.
I20260808 07:08:49.960803 21755 tablet_bootstrap.cc:654] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:49.961983 21755 log.cc:824] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:49.962546 21757 tablet_bootstrap.cc:492] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c: Bootstrap starting.
I20260808 07:08:49.962625 21756 tablet_bootstrap.cc:654] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:49.963871 21756 log.cc:824] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:49.965265 21757 tablet_bootstrap.cc:654] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:49.965353 21756 tablet_bootstrap.cc:492] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c: No bootstrap required, opened a new log
I20260808 07:08:49.965437 21756 ts_tablet_manager.cc:1397] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 07:08:49.966498 21757 log.cc:824] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:49.967959 21755 tablet_bootstrap.cc:492] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812: No bootstrap required, opened a new log
I20260808 07:08:49.968151 21755 ts_tablet_manager.cc:1397] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260808 07:08:49.971165 21756 raft_consensus.cc:348] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ecd1505fbe435da8f99e4e06674d9c" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36773 } } peers { permanent_uuid: "5754582afb304e7d9c9ca408888a9812" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34703 } } peers { permanent_uuid: "17561acd711442bb8e9c80cf20a7a58c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36487 } }
I20260808 07:08:49.971522 21756 raft_consensus.cc:374] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:49.971580 21756 raft_consensus.cc:729] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17561acd711442bb8e9c80cf20a7a58c, State: Initialized, Role: FOLLOWER
I20260808 07:08:49.971745 21756 consensus_queue.cc:260] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ecd1505fbe435da8f99e4e06674d9c" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36773 } } peers { permanent_uuid: "5754582afb304e7d9c9ca408888a9812" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34703 } } peers { permanent_uuid: "17561acd711442bb8e9c80cf20a7a58c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36487 } }
I20260808 07:08:49.972185 21756 ts_tablet_manager.cc:1428] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 07:08:49.972383 21736 heartbeater.cc:503] Master 127.9.94.62:35353 was elected leader, sending a full tablet report...
I20260808 07:08:49.973557 21755 raft_consensus.cc:348] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ecd1505fbe435da8f99e4e06674d9c" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36773 } } peers { permanent_uuid: "5754582afb304e7d9c9ca408888a9812" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34703 } } peers { permanent_uuid: "17561acd711442bb8e9c80cf20a7a58c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36487 } }
I20260808 07:08:49.973937 21755 raft_consensus.cc:374] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:49.974052 21755 raft_consensus.cc:729] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5754582afb304e7d9c9ca408888a9812, State: Initialized, Role: FOLLOWER
I20260808 07:08:49.974373 21755 consensus_queue.cc:260] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ecd1505fbe435da8f99e4e06674d9c" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36773 } } peers { permanent_uuid: "5754582afb304e7d9c9ca408888a9812" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34703 } } peers { permanent_uuid: "17561acd711442bb8e9c80cf20a7a58c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36487 } }
I20260808 07:08:49.974861 21755 ts_tablet_manager.cc:1428] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 07:08:49.974892 21596 heartbeater.cc:503] Master 127.9.94.62:35353 was elected leader, sending a full tablet report...
I20260808 07:08:49.976052 21757 tablet_bootstrap.cc:492] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c: No bootstrap required, opened a new log
I20260808 07:08:49.976233 21757 ts_tablet_manager.cc:1397] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.005s
W20260808 07:08:49.977270 21597 tablet.cc:2369] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:08:49.980563 21757 raft_consensus.cc:348] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ecd1505fbe435da8f99e4e06674d9c" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36773 } } peers { permanent_uuid: "5754582afb304e7d9c9ca408888a9812" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34703 } } peers { permanent_uuid: "17561acd711442bb8e9c80cf20a7a58c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36487 } }
I20260808 07:08:49.980767 21757 raft_consensus.cc:374] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:49.980818 21757 raft_consensus.cc:729] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94ecd1505fbe435da8f99e4e06674d9c, State: Initialized, Role: FOLLOWER
I20260808 07:08:49.980988 21757 consensus_queue.cc:260] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ecd1505fbe435da8f99e4e06674d9c" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36773 } } peers { permanent_uuid: "5754582afb304e7d9c9ca408888a9812" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34703 } } peers { permanent_uuid: "17561acd711442bb8e9c80cf20a7a58c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36487 } }
I20260808 07:08:49.981405 21757 ts_tablet_manager.cc:1428] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260808 07:08:49.981520 21453 heartbeater.cc:503] Master 127.9.94.62:35353 was elected leader, sending a full tablet report...
W20260808 07:08:50.067276 21454 tablet.cc:2369] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:08:50.070504 21764 raft_consensus.cc:482] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:08:50.070664 21764 raft_consensus.cc:504] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ecd1505fbe435da8f99e4e06674d9c" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36773 } } peers { permanent_uuid: "5754582afb304e7d9c9ca408888a9812" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34703 } } peers { permanent_uuid: "17561acd711442bb8e9c80cf20a7a58c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36487 } }
I20260808 07:08:50.071143 21764 leader_election.cc:288] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5754582afb304e7d9c9ca408888a9812 (127.9.94.2:34703), 17561acd711442bb8e9c80cf20a7a58c (127.9.94.3:36487)
I20260808 07:08:50.076710 21754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:50.071894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:37325 (local address 127.9.94.3:36487)
0808 07:08:50.072053 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:50.072056 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:50.072262 (+ 206us) server_negotiation.cc:407] Connection header received
0808 07:08:50.072389 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:50.072391 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:50.072402 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:50.072437 (+ 35us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:50.072700 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:50.073568 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:50.075279 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:50.075969 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:50.076029 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:50.076043 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:50.076573 (+ 530us) server_negotiation.cc:299] Negotiation successful
0808 07:08:50.076624 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260808 07:08:50.077553 21766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:50.071503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:36487 (local address 127.9.94.1:37325)
0808 07:08:50.072174 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:50.072187 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:50.072295 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:50.072515 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:50.072516 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:50.072518 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:50.072611 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:50.072613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:50.073707 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:50.073708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:50.075114 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:50.075118 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:50.076118 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:50.076119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:50.076338 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:50.076344 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:08:50.077263 (+ 919us) client_negotiation.cc:240] Negotiation successful
0808 07:08:50.077348 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":141,"threads_started":1}
I20260808 07:08:50.078481 21671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1638d93a45d24506aff9b0da28c8be94" candidate_uuid: "94ecd1505fbe435da8f99e4e06674d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17561acd711442bb8e9c80cf20a7a58c" is_pre_election: true
I20260808 07:08:50.078718 21671 raft_consensus.cc:2454] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94ecd1505fbe435da8f99e4e06674d9c in term 0.
I20260808 07:08:50.079242 21333 leader_election.cc:302] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17561acd711442bb8e9c80cf20a7a58c, 94ecd1505fbe435da8f99e4e06674d9c; no voters:
I20260808 07:08:50.080323 21764 raft_consensus.cc:2781] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:08:50.080399 21764 raft_consensus.cc:482] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:08:50.080428 21764 raft_consensus.cc:3037] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:50.082581 21764 raft_consensus.cc:504] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ecd1505fbe435da8f99e4e06674d9c" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36773 } } peers { permanent_uuid: "5754582afb304e7d9c9ca408888a9812" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34703 } } peers { permanent_uuid: "17561acd711442bb8e9c80cf20a7a58c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36487 } }
I20260808 07:08:50.082854 21764 leader_election.cc:288] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [CANDIDATE]: Term 1 election: Requested vote from peers 5754582afb304e7d9c9ca408888a9812 (127.9.94.2:34703), 17561acd711442bb8e9c80cf20a7a58c (127.9.94.3:36487)
I20260808 07:08:50.083254 21671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1638d93a45d24506aff9b0da28c8be94" candidate_uuid: "94ecd1505fbe435da8f99e4e06674d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17561acd711442bb8e9c80cf20a7a58c"
I20260808 07:08:50.083355 21671 raft_consensus.cc:3037] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:50.085321 21671 raft_consensus.cc:2454] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94ecd1505fbe435da8f99e4e06674d9c in term 1.
I20260808 07:08:50.085734 21333 leader_election.cc:302] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17561acd711442bb8e9c80cf20a7a58c, 94ecd1505fbe435da8f99e4e06674d9c; no voters:
I20260808 07:08:50.085879 21764 raft_consensus.cc:2781] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:08:50.086071 21764 raft_consensus.cc:686] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [term 1 LEADER]: Becoming Leader. State: Replica: 94ecd1505fbe435da8f99e4e06674d9c, State: Running, Role: LEADER
I20260808 07:08:50.086169 21764 consensus_queue.cc:237] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ecd1505fbe435da8f99e4e06674d9c" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36773 } } peers { permanent_uuid: "5754582afb304e7d9c9ca408888a9812" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34703 } } peers { permanent_uuid: "17561acd711442bb8e9c80cf20a7a58c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36487 } }
I20260808 07:08:50.087100 21233 catalog_manager.cc:5495] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 94ecd1505fbe435da8f99e4e06674d9c (127.9.94.1). New cstate: current_term: 1 leader_uuid: "94ecd1505fbe435da8f99e4e06674d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ecd1505fbe435da8f99e4e06674d9c" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5754582afb304e7d9c9ca408888a9812" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17561acd711442bb8e9c80cf20a7a58c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36487 } health_report { overall_health: UNKNOWN } } }
I20260808 07:08:50.087780 21753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:50.072105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:50337 (local address 127.9.94.2:34703)
0808 07:08:50.072154 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:50.072156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:50.076312 (+ 4156us) server_negotiation.cc:407] Connection header received
0808 07:08:50.076388 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:50.076389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:50.076406 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:50.076458 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:50.079440 (+ 2982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:50.080194 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:50.086551 (+ 6357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:50.087151 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:50.087206 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:50.087218 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:50.087653 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 07:08:50.087709 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:08:50.090052 21765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:50.071948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:34703 (local address 127.9.94.1:50337)
0808 07:08:50.076207 (+ 4259us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:50.076222 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:50.076325 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:50.079065 (+ 2740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:50.079066 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:50.079069 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:50.079306 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:50.079309 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:50.084890 (+ 5581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:50.084893 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:50.086384 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:50.086388 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:50.087421 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:50.087423 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:50.087543 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:50.087549 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:08:50.088233 (+ 684us) client_negotiation.cc:240] Negotiation successful
0808 07:08:50.089787 (+ 1554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4211,"thread_start_us":100,"threads_started":1}
I20260808 07:08:50.090956 21549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1638d93a45d24506aff9b0da28c8be94" candidate_uuid: "94ecd1505fbe435da8f99e4e06674d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5754582afb304e7d9c9ca408888a9812" is_pre_election: true
I20260808 07:08:50.091060 21545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1638d93a45d24506aff9b0da28c8be94" candidate_uuid: "94ecd1505fbe435da8f99e4e06674d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5754582afb304e7d9c9ca408888a9812"
I20260808 07:08:50.091156 21545 raft_consensus.cc:3037] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:50.092924 21545 raft_consensus.cc:2454] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94ecd1505fbe435da8f99e4e06674d9c in term 1.
I20260808 07:08:50.120733 21751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:50.117067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43356 (local address 127.9.94.1:36773)
0808 07:08:50.117130 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:50.117133 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:50.117147 (+ 14us) server_negotiation.cc:407] Connection header received
0808 07:08:50.117193 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:50.117194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:50.117218 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:50.117327 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:08:50.117530 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:50.118406 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:50.119668 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:50.119999 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:50.120105 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:50.120307 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:08:50.120440 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:08:50.120547 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:50.120595 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 07:08:50.120623 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:08:50.123168 21671 raft_consensus.cc:1261] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c [term 1 FOLLOWER]: Refusing update from remote peer 94ecd1505fbe435da8f99e4e06674d9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:08:50.123215 21545 raft_consensus.cc:1261] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812 [term 1 FOLLOWER]: Refusing update from remote peer 94ecd1505fbe435da8f99e4e06674d9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:08:50.123545 21764 consensus_queue.cc:1035] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5754582afb304e7d9c9ca408888a9812" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:08:50.123754 21764 consensus_queue.cc:1035] T 1638d93a45d24506aff9b0da28c8be94 P 94ecd1505fbe435da8f99e4e06674d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17561acd711442bb8e9c80cf20a7a58c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 36487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:08:50.134107 21770 mvcc.cc:205] Tried to move back new op lower bound from 7316164321781735424 to 7316164321633619968. Current Snapshot: MvccSnapshot[applied={T|T < 7316164321781735424 or (T in {7316164321781735424})}]
I20260808 07:08:50.134582 21233 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51634:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:08:50.134752 21233 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51634:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:08:50.135739 21772 mvcc.cc:205] Tried to move back new op lower bound from 7316164321781735424 to 7316164321633619968. Current Snapshot: MvccSnapshot[applied={T|T < 7316164321781735424}]
I20260808 07:08:50.135855 21233 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74d5ffca707c4a71b05824d0a4498933: Sending DeleteTablet for 3 replicas of tablet 1638d93a45d24506aff9b0da28c8be94
I20260808 07:08:50.136340 21382 tablet_service.cc:1514] Processing DeleteTablet for tablet 1638d93a45d24506aff9b0da28c8be94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:50 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:43348
I20260808 07:08:50.136638 21519 tablet_service.cc:1514] Processing DeleteTablet for tablet 1638d93a45d24506aff9b0da28c8be94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:50 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:57702
I20260808 07:08:50.136955 21667 tablet_service.cc:1514] Processing DeleteTablet for tablet 1638d93a45d24506aff9b0da28c8be94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:50 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:59958
I20260808 07:08:50.137459 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 21316
I20260808 07:08:50.141762 21780 tablet_replica.cc:330] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812: stopping tablet replica
I20260808 07:08:50.141912 21780 raft_consensus.cc:2229] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:08:50.142053 21780 raft_consensus.cc:2258] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:50.143781 21780 ts_tablet_manager.cc:1905] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:08:50.146032 21781 tablet_replica.cc:330] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c: stopping tablet replica
I20260808 07:08:50.146178 21781 raft_consensus.cc:2229] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:08:50.146309 21781 raft_consensus.cc:2258] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:50.146535 21780 ts_tablet_manager.cc:1918] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:08:50.146611 21780 log.cc:1196] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/1638d93a45d24506aff9b0da28c8be94
I20260808 07:08:50.146914 21780 ts_tablet_manager.cc:1939] T 1638d93a45d24506aff9b0da28c8be94 P 5754582afb304e7d9c9ca408888a9812: Deleting consensus metadata
I20260808 07:08:50.148914 21220 catalog_manager.cc:4841] TS 5754582afb304e7d9c9ca408888a9812 (127.9.94.2:34703): tablet 1638d93a45d24506aff9b0da28c8be94 (table test-table [id=dfe99798cbf34ea189a424294a5a9e6b]) successfully deleted
I20260808 07:08:50.151103 21781 ts_tablet_manager.cc:1905] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 07:08:50.151228 21219 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:36773 (error 108)
I20260808 07:08:50.152277 21750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:50.152144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:36773 (local address 127.0.0.1:43370)
0808 07:08:50.152195 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:50.152235 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:36773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 07:08:50.152302 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 21459
W20260808 07:08:50.152412 21219 catalog_manager.cc:4584] TS 94ecd1505fbe435da8f99e4e06674d9c (127.9.94.1:36773): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1638d93a45d24506aff9b0da28c8be94: Network error: Client connection negotiation failed: client connection to 127.9.94.1:36773: connect: Connection refused (error 111)
I20260808 07:08:50.157641 21781 ts_tablet_manager.cc:1918] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:08:50.157768 21781 log.cc:1196] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/1638d93a45d24506aff9b0da28c8be94
I20260808 07:08:50.158496 21781 ts_tablet_manager.cc:1939] T 1638d93a45d24506aff9b0da28c8be94 P 17561acd711442bb8e9c80cf20a7a58c: Deleting consensus metadata
I20260808 07:08:50.159089 21217 catalog_manager.cc:4841] TS 17561acd711442bb8e9c80cf20a7a58c (127.9.94.3:36487): tablet 1638d93a45d24506aff9b0da28c8be94 (table test-table [id=dfe99798cbf34ea189a424294a5a9e6b]) successfully deleted
I20260808 07:08:50.168296 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 21603
I20260808 07:08:50.176708 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 21201
I20260808 07:08:50.186969 9592 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 07:08:50.532611 9592 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 07:08:50.532784 9592 mini_ranger.cc:66] Stopping Ranger...
I20260808 07:08:50.878640 9592 mini_ranger.cc:68] Stopped Ranger
2026-08-08 07:08:50.878 UTC [20770] LOG: received smart shutdown request
2026-08-08 07:08:50.883 UTC [20770] LOG: background worker "logical replication launcher" (PID 20779) exited with exit code 1
2026-08-08 07:08:50.884 UTC [20774] LOG: shutting down
2026-08-08 07:08:51.099 UTC [20770] LOG: database system is shut down
2026-08-08T07:08:51Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (57090 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:08:51 dist-test-slave-77v9 krb5kdc[21791](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:08:51 dist-test-slave-77v9 krb5kdc[21791](info): set up 2 sockets
Aug 08 07:08:51 dist-test-slave-77v9 krb5kdc[21791](info): commencing operation
krb5kdc: starting...
W20260808 07:08:52.358489 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:08:52 dist-test-slave-77v9 krb5kdc[21791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:08:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:08:52Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.9.94.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.9.94.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/rangeradmin_127.9.94.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/rangeradmin_127.9.94.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.9.94.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.9.94.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/rangerlookup_127.9.94.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/rangerlookup_127.9.94.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.94.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.9.94.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/HTTP_127.9.94.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/HTTP_127.9.94.20@KRBTEST.COM.keytab.
I20260808 07:08:52.576579 9592 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskfmG05D/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/postgres -l logfile start
2026-08-08 07:08:55.832 UTC [21821] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 07:08:55.832 UTC [21821] LOG: listening on IPv4 address "127.9.94.20", port 45959
2026-08-08 07:08:55.837 UTC [21821] LOG: listening on Unix socket "/tmp/.s.PGSQL.45959"
2026-08-08 07:08:55.877 UTC [21824] LOG: database system was shut down at 2026-08-08 07:08:53 UTC
2026-08-08 07:08:55.883 UTC [21821] LOG: database system is ready to accept connections
I20260808 07:08:56.948194 9592 mini_postgres.cc:96] Postgres bound to 45959
2026-08-08 07:08:56.956 UTC [21833] FATAL: database "slave" does not exist
127.9.94.20:45959 - accepting connections
I20260808 07:08:56.957181 9592 mini_ranger.cc:161] Starting Ranger...
I20260808 07:08:56.974345 9592 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 07:08:57.656761 9592 mini_ranger.cc:87] Created ranger Postgres database
I20260808 07:08:57.656893 9592 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-admin
2026-08-08 07:08:57,970 [I] DB FLAVOR :POSTGRES
2026-08-08 07:08:57,970 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 07:08:57,970 [I] Checking connection..
2026-08-08 07:08:57,971 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 07:08:58,259 [I] Checking connection passed.
2026-08-08 07:08:58,260 [I] --------- Verifying version history table ---------
2026-08-08 07:08:58,260 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:08:58,562 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 07:08:58,562 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:08:58,829 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 07:08:58,830 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 07:08:58,830 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 07:08:59.131 UTC [21902] WARNING: there is no transaction in progress
2026-08-08 07:08:59,139 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 07:08:59,140 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:08:59,414 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 07:08:59,414 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 07:08:59,414 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 07:08:59,691 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 07:08:59,974 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-77v9.c.gcp-upstream.internal','N') ;"
2026-08-08 07:09:00,239 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 07:09:00,551 [I] Table x_portal_user does not exist in database ranger
2026-08-08 07:09:00,551 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 07:09:00,850 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 07:09:00,850 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 07:09:01,151 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 07:09:01,471 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 07:09:01,471 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 07:09:02.915 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:02.946 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:02.973 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:02.999 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:03.022 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:03.049 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:03.127 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:03.136 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:03.156 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:03.171 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:03.185 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:03.205 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:03.219 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:03.229 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:03.241 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:03.252 UTC [22014] WARNING: there is no transaction in progress
2026-08-08 07:09:04,305 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 07:09:04,305 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 07:09:04,559 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 07:09:04,559 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 07:09:04,861 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 07:09:04,861 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 07:09:05,150 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 07:09:05,150 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 07:09:05,438 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 07:09:05,712 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-77v9.c.gcp-upstream.internal';"
2026-08-08 07:09:05,969 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 07:09:05,969 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 07:09:06,247 [I] DB_PATCHES have already been applied
I20260808 07:09:06.254575 9592 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-admin:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskfmG05D/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 07:09:06.254685 9592 mini_ranger.cc:193] Using host: 127.9.94.20
I20260808 07:09:06.259461 9592 mini_ranger.cc:227] Ranger admin URL: http://127.9.94.20:56413
Aug 08, 2026 7:09:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 7:09:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 7:09:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 7:09:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 7:09:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 7:09:07 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 7:09:07 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 07:09:07.519546 9592 mini_ranger.cc:160] Time spent starting Ranger: real 10.562s user 0.000s sys 0.012s
Aug 08, 2026 7:09:29 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 7:09:29 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Aug 08, 2026 7:09:29 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 7:09:29 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 7:09:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 7:09:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 7:09:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 7:09:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 7:09:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 7:09:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 7:09:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 7:09:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 7:09:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 7:09:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 7:09:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 7:09:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 7:09:29 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 7:09:30 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 07:09:31.429062 9592 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.9.94.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.9.94.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/rangerkms_127.9.94.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.9.94.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/rangerkms_127.9.94.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.94.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.9.94.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.94.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/HTTP_127.9.94.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.94.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/HTTP_127.9.94.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 07:09:31 dist-test-slave-77v9 krb5kdc[21791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172971, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 07:09:31.546204 9592 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 07:09:31.558655 9592 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 07:09:32.770282 9592 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 07:09:32.770370 9592 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-kms
I20260808 07:09:32.770385 9592 mini_ranger_kms.cc:227] Using postgres at 127.9.94.20:45959
2026-08-08 07:09:32,967 [I] DB FLAVOR :POSTGRES
2026-08-08 07:09:32,967 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 07:09:32,967 [I] Checking connection
2026-08-08 07:09:32,968 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 07:09:33,248 [I] connection success
2026-08-08 07:09:33,249 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 07:09:33,249 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 07:09:33,249 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 07:09:33,525 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 07:09:33,525 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 07:09:33,526 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 07:09:33,526 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.94.20:45959/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 07:09:33,837 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 07:09:34.365732 9592 mini_ranger_kms.cc:310] Created kms service
I20260808 07:09:34.566619 9592 mini_ranger_kms.cc:326] Created kudu user
I20260808 07:09:34.616554 9592 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 07:09:34 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172971, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
I20260808 07:09:35.076188 9592 mini_ranger_kms.cc:384] Added ranger policy
I20260808 07:09:35.076344 9592 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-kms:/tmp/dist-test-taskfmG05D/build/release/bin/postgresql.jar:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskfmG05D/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 07:09:35.076365 9592 mini_ranger_kms.cc:240] Using host: 127.9.94.20
I20260808 07:09:35.081101 9592 mini_ranger_kms.cc:276] Ranger KMS PID: 22202
I20260808 07:09:35.081204 9592 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.9.94.20:40459
Aug 08, 2026 7:09:36 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 7:09:36 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 7:09:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 7:09:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 7:09:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 7:09:36 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 07:09:37.486321 9592 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.940s user 0.008s sys 0.168s
I20260808 07:09:37.486431 9592 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 07:09:37.486487 9592 mini_ranger_kms.cc:401] 127.9.94.20:40459/kms/v1/keys
Aug 08 07:09:37 dist-test-slave-77v9 krb5kdc[21791](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786172977, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.94.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 07:09:38 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172977, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.94.20@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
Aug 08 07:09:38 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172977, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.94.20@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
Aug 08 07:09:40 dist-test-slave-77v9 krb5kdc[21791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:09:40.921231 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:41343
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:41343
--ranger_config_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.94.20:40459/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:41.009922 22253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:41.010147 22253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:41.010171 22253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:41.011368 22253 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:41.011421 22253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:41.011436 22253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:41.011448 22253 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:41.011461 22253 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:41.013275 22253 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/wal
--ranger_kms_url=127.9.94.20:40459/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:41343
--ranger_config_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:41343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:41.013537 22253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:41.013813 22253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:41.020593 22259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:41.020707 22253 server_base.cc:1034] running on GCE node
W20260808 07:09:41.020592 22261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:41.020744 22258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:41.021270 22253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:41.021644 22253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:41.022830 22253 hybrid_clock.cc:648] HybridClock initialized: now 1786172981022824 us; error 43 us; skew 500 ppm
Aug 08 07:09:41 dist-test-slave-77v9 krb5kdc[21791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172981, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:41.026069 22253 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:09:41.026753 22253 webserver.cc:460] Webserver started at http://127.9.94.62:42503/ using document root <none> and password file <none>
I20260808 07:09:41.027115 22253 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:41.027205 22253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:41.027412 22253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:09:41 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172981, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
I20260808 07:09:41.089561 22253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "03d55429c3df4c74a9f41d5c2510352a"
format_stamp: "Formatted at 2026-08-08 07:09:41 on dist-test-slave-77v9"
server_key: "d03b78057384eec2d9c309d6ac14f4c4"
server_key_iv: "df0a8c878dfb4cf23acce882c8d21589"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:41.089920 22253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "03d55429c3df4c74a9f41d5c2510352a"
format_stamp: "Formatted at 2026-08-08 07:09:41 on dist-test-slave-77v9"
server_key: "d03b78057384eec2d9c309d6ac14f4c4"
server_key_iv: "df0a8c878dfb4cf23acce882c8d21589"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:41.091361 22253 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:09:41.106655 22268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:41.106948 22253 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:41.107054 22253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "03d55429c3df4c74a9f41d5c2510352a"
format_stamp: "Formatted at 2026-08-08 07:09:41 on dist-test-slave-77v9"
server_key: "d03b78057384eec2d9c309d6ac14f4c4"
server_key_iv: "df0a8c878dfb4cf23acce882c8d21589"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:41.107156 22253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:41.131590 22253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:41.133927 22253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:41.134112 22253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:41.139319 22253 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:41343
I20260808 07:09:41.139344 22322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:41343 every 8 connection(s)
I20260808 07:09:41.139816 22253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:41.140542 22323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:41.142942 22323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a: Bootstrap starting.
I20260808 07:09:41.143584 22323 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:41.143898 22323 log.cc:824] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:41.144636 22323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a: No bootstrap required, opened a new log
I20260808 07:09:41.146828 22323 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d55429c3df4c74a9f41d5c2510352a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 41343 } }
I20260808 07:09:41.146987 22323 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:41.147012 22323 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03d55429c3df4c74a9f41d5c2510352a, State: Initialized, Role: FOLLOWER
I20260808 07:09:41.147167 22323 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d55429c3df4c74a9f41d5c2510352a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 41343 } }
I20260808 07:09:41.147243 22323 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:41.147266 22323 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:41.147332 22323 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:41.147900 22323 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d55429c3df4c74a9f41d5c2510352a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 41343 } }
I20260808 07:09:41.147998 22323 leader_election.cc:302] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03d55429c3df4c74a9f41d5c2510352a; no voters:
I20260808 07:09:41.148207 22323 leader_election.cc:288] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:41.148267 22326 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:41.148469 22326 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 1 LEADER]: Becoming Leader. State: Replica: 03d55429c3df4c74a9f41d5c2510352a, State: Running, Role: LEADER
I20260808 07:09:41.148486 22323 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:41.148558 22326 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d55429c3df4c74a9f41d5c2510352a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 41343 } }
I20260808 07:09:41.149008 22326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03d55429c3df4c74a9f41d5c2510352a. Latest consensus state: current_term: 1 leader_uuid: "03d55429c3df4c74a9f41d5c2510352a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d55429c3df4c74a9f41d5c2510352a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 41343 } } }
I20260808 07:09:41.149341 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 22253
I20260808 07:09:41.149441 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:09:41.149622 9592 external_mini_cluster.cc:1428] Setting key fa11522f59aec4e8f3e923fc863edeee
I20260808 07:09:41.149885 22326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:41.150082 22323 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 07:09:41.150332 22340 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:41.149019 22327 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03d55429c3df4c74a9f41d5c2510352a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d55429c3df4c74a9f41d5c2510352a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 41343 } } }
I20260808 07:09:41.150488 22327 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:41.153245 22340 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:41.157498 22340 catalog_manager.cc:1347] Generated new cluster ID: f3f551d68d4d4c2eb63a5caa939ef8c0
I20260808 07:09:41.157569 22340 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:09:41 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:41.170763 22343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:41.150329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37282 (local address 127.9.94.62:41343)
0808 07:09:41.152672 (+ 2343us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:41.152702 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:41.157041 (+ 4339us) server_negotiation.cc:407] Connection header received
0808 07:09:41.157285 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:41.157294 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:41.157351 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:41.157465 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:41.158406 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:41.160207 (+ 1801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:41.161476 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:41.162189 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:41.162300 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:41.165861 (+ 3561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:41.165869 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:41.165869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:41.165884 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:41.168183 (+ 2299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:41.168620 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:41.168623 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:41.168623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:41.168737 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:41.168992 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:41.168993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:41.168993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:41.169352 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:41.169495 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:41.169978 (+ 483us) server_negotiation.cc:299] Negotiation successful
0808 07:09:41.170121 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":2180,"thread_start_us":91,"threads_started":1}
I20260808 07:09:41.188066 22340 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:41.188989 22340 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:41.196599 22340 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a: Generated new TSK 0
I20260808 07:09:41.197002 22340 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:09:41.947999 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.94.20:40459/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:41343
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:42.067857 22369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:42.068128 22369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:42.068171 22369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:42.069836 22369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:42.069914 22369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:42.069964 22369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:09:42.072011 22369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.9.94.20:40459/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:41343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:42.072335 22369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:42.072616 22369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:42.079104 22375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:42.079279 22374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:42.079113 22377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:42.079862 22369 server_base.cc:1034] running on GCE node
I20260808 07:09:42.080104 22369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:42.080369 22369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:42.081563 22369 hybrid_clock.cc:648] HybridClock initialized: now 1786172982081549 us; error 33 us; skew 500 ppm
Aug 08 07:09:42 dist-test-slave-77v9 krb5kdc[21791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172982, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:42.084657 22369 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:09:42.085286 22369 webserver.cc:460] Webserver started at http://127.9.94.1:45633/ using document root <none> and password file <none>
I20260808 07:09:42.085542 22369 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:42.085613 22369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:42.085800 22369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:09:42 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172982, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
I20260808 07:09:42.101590 22369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "22bc333dca0c4ed1b4426c3dd164f2e2"
format_stamp: "Formatted at 2026-08-08 07:09:42 on dist-test-slave-77v9"
server_key: "844cdacac223cd3d9af784d31755961f"
server_key_iv: "d252026a0c66ec1001d4f45f4090e0f3"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:42.102072 22369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "22bc333dca0c4ed1b4426c3dd164f2e2"
format_stamp: "Formatted at 2026-08-08 07:09:42 on dist-test-slave-77v9"
server_key: "844cdacac223cd3d9af784d31755961f"
server_key_iv: "d252026a0c66ec1001d4f45f4090e0f3"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:42.103756 22369 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:09:42.118690 22384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:42.118940 22369 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:09:42.119050 22369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "22bc333dca0c4ed1b4426c3dd164f2e2"
format_stamp: "Formatted at 2026-08-08 07:09:42 on dist-test-slave-77v9"
server_key: "844cdacac223cd3d9af784d31755961f"
server_key_iv: "d252026a0c66ec1001d4f45f4090e0f3"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:42.119175 22369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:42.145538 22369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:42.148257 22369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:42.148494 22369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:42.148947 22369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:42.149500 22369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:42.149578 22369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:42.149621 22369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:42.149670 22369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:42.171463 22369 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:36083
I20260808 07:09:42.171567 22500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:36083 every 8 connection(s)
I20260808 07:09:42.171912 22369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:09:42.177052 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 22369
I20260808 07:09:42.177166 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:09:42.177376 9592 external_mini_cluster.cc:1428] Setting key ae66f0e0e809e717b0ddaef93d7fbc35
Aug 08 07:09:42 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172982, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:42.185312 22503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:42.174839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:44339 (local address 127.9.94.62:41343)
0808 07:09:42.175063 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:42.175065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:42.175285 (+ 220us) server_negotiation.cc:407] Connection header received
0808 07:09:42.175871 (+ 586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:42.175872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:42.175886 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:42.176008 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:42.176622 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:42.177607 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:42.178652 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:42.178942 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:42.179030 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:42.181452 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:42.181454 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:42.181454 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:42.181462 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:42.183478 (+ 2016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:42.184017 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:42.184019 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:42.184019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:42.184083 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:42.184395 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:42.184396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:42.184397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:42.184558 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:42.184645 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:42.185079 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 07:09:42.185179 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":140,"threads_started":1}
I20260808 07:09:42.186249 22504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:42.174803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:41343 (local address 127.9.94.1:44339)
0808 07:09:42.175130 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:42.175175 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:42.175713 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:42.176077 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:42.176082 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:42.176310 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:42.176517 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:42.176521 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:42.177709 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:42.177710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:42.178548 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:42.178550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:42.179056 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:42.179057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:42.179217 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:42.179887 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:42.179897 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:42.181344 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:42.183579 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:42.183586 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:42.183589 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:42.183928 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:42.184148 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:42.184149 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:42.184149 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:42.184301 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:42.184654 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:42.184661 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:42.184886 (+ 225us) client_negotiation.cc:769] Sending connection context
0808 07:09:42.185681 (+ 795us) client_negotiation.cc:240] Negotiation successful
0808 07:09:42.185883 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":186,"threads_started":1}
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
I20260808 07:09:42.190687 22501 heartbeater.cc:347] Connected to a master server at 127.9.94.62:41343
I20260808 07:09:42.190801 22501 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:42.191067 22501 heartbeater.cc:511] Master 127.9.94.62:41343 requested a full tablet report, sending...
I20260808 07:09:42.191713 22286 ts_manager.cc:194] Registered new tserver with Master: 22bc333dca0c4ed1b4426c3dd164f2e2 (127.9.94.1:36083)
I20260808 07:09:42.192669 22286 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:44339
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:09:42.220429 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.94.20:40459/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:41343
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:42.395648 22509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:42.395962 22509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:42.396004 22509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:42.398198 22509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:42.398279 22509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:42.398329 22509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:09:42.401436 22509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.9.94.20:40459/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:41343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:42.401885 22509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:42.402210 22509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:09:42.414422 22509 server_base.cc:1034] running on GCE node
W20260808 07:09:42.414552 22516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:42.414829 22517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:42.414867 22520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:42.415346 22509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:42.415673 22509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:42.417225 22509 hybrid_clock.cc:648] HybridClock initialized: now 1786172982417194 us; error 53 us; skew 500 ppm
Aug 08 07:09:42 dist-test-slave-77v9 krb5kdc[21791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172982, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:42.422637 22509 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:09:42.423345 22509 webserver.cc:460] Webserver started at http://127.9.94.2:36261/ using document root <none> and password file <none>
I20260808 07:09:42.423682 22509 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:42.423799 22509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:42.424041 22509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:09:42 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172982, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
Aug 08 07:09:42 dist-test-slave-77v9 krb5kdc[21791](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786172982, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:42.453014 22509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "8f34aa3289eb49e0a51ae9c62788a588"
format_stamp: "Formatted at 2026-08-08 07:09:42 on dist-test-slave-77v9"
server_key: "ae09a07ec03ede5605a05bd8eaed724b"
server_key_iv: "a7236e28c4c3fbf8765d9dee397538e5"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:42.453579 22509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "8f34aa3289eb49e0a51ae9c62788a588"
format_stamp: "Formatted at 2026-08-08 07:09:42 on dist-test-slave-77v9"
server_key: "ae09a07ec03ede5605a05bd8eaed724b"
server_key_iv: "a7236e28c4c3fbf8765d9dee397538e5"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:42.456169 22509 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260808 07:09:42.476759 22527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:42.477135 22509 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.000s sys 0.002s
I20260808 07:09:42.477255 22509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "8f34aa3289eb49e0a51ae9c62788a588"
format_stamp: "Formatted at 2026-08-08 07:09:42 on dist-test-slave-77v9"
server_key: "ae09a07ec03ede5605a05bd8eaed724b"
server_key_iv: "a7236e28c4c3fbf8765d9dee397538e5"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:42.477375 22509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:42.502645 22509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:42.505569 22509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:42.505815 22509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:42.506239 22509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:42.506800 22509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:42.506914 22509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:42.507148 22509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:42.507229 22509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:42.534348 22509 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:41597
I20260808 07:09:42.534802 22642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:41597 every 8 connection(s)
I20260808 07:09:42.535125 22509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:09:42.537333 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 22509
I20260808 07:09:42.537443 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:09:42.537632 9592 external_mini_cluster.cc:1428] Setting key 84238a54ea14f47c2f8a71f2c0c75861
Aug 08 07:09:42 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172982, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:42.550123 22645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:42.536015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:41343 (local address 127.9.94.2:53081)
0808 07:09:42.536603 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:42.536653 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:42.537752 (+ 1099us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:42.538540 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:42.538544 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:42.538982 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:42.539449 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:42.539456 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:42.540533 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:42.540534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:42.541870 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:42.541873 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:42.542592 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:42.542594 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:42.542797 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:42.543602 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:42.543613 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:42.546060 (+ 2447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:42.548143 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:42.548151 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:42.548154 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:42.548510 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:42.548735 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:42.548735 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:42.548736 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:42.548914 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:42.549233 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:42.549239 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:42.549498 (+ 259us) client_negotiation.cc:769] Sending connection context
0808 07:09:42.549615 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 07:09:42.549800 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":178,"threads_started":1}
I20260808 07:09:42.550693 22503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:42.536419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:53081 (local address 127.9.94.62:41343)
0808 07:09:42.536467 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:42.536469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:42.536768 (+ 299us) server_negotiation.cc:407] Connection header received
0808 07:09:42.538006 (+ 1238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:42.538008 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:42.538022 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:42.538056 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:42.539588 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:42.540415 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:42.541980 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:42.542370 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:42.542451 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:42.546201 (+ 3750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:42.546203 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:42.546203 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:42.546212 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:42.548034 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:42.548602 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:42.548603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:42.548604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:42.548666 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:42.548993 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:42.548994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:42.548994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:42.549147 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:42.549207 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:42.550501 (+ 1294us) server_negotiation.cc:299] Negotiation successful
0808 07:09:42.550599 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:09:42.551518 22643 heartbeater.cc:347] Connected to a master server at 127.9.94.62:41343
I20260808 07:09:42.551625 22643 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:42.551831 22643 heartbeater.cc:511] Master 127.9.94.62:41343 requested a full tablet report, sending...
I20260808 07:09:42.552165 22286 ts_manager.cc:194] Registered new tserver with Master: 8f34aa3289eb49e0a51ae9c62788a588 (127.9.94.2:41597)
I20260808 07:09:42.552628 22286 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:53081
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:09:42.591846 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.94.20:40459/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:41343
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:42.746477 22649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:42.746766 22649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:42.746814 22649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:42.748735 22649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:42.748888 22649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:42.749017 22649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:09:42.751223 22649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.9.94.20:40459/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:41343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:42.751811 22649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:42.752179 22649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:42.759969 22655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:42.759969 22654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:42.760324 22657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:42.762025 22649 server_base.cc:1034] running on GCE node
I20260808 07:09:42.762269 22649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:42.762522 22649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:42.765805 22649 hybrid_clock.cc:648] HybridClock initialized: now 1786172982765769 us; error 43 us; skew 500 ppm
Aug 08 07:09:42 dist-test-slave-77v9 krb5kdc[21791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172982, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:42.774328 22649 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:09:42.774991 22649 webserver.cc:460] Webserver started at http://127.9.94.3:46393/ using document root <none> and password file <none>
I20260808 07:09:42.775290 22649 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:42.775364 22649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:42.775668 22649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:09:42 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172982, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
I20260808 07:09:42.795099 22649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7"
format_stamp: "Formatted at 2026-08-08 07:09:42 on dist-test-slave-77v9"
server_key: "e5bdd26ab8fc51f79fb6c1da7d5b721a"
server_key_iv: "f2ac9c5d5eca68822b278588ac00b59c"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:42.795681 22649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7"
format_stamp: "Formatted at 2026-08-08 07:09:42 on dist-test-slave-77v9"
server_key: "e5bdd26ab8fc51f79fb6c1da7d5b721a"
server_key_iv: "f2ac9c5d5eca68822b278588ac00b59c"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:42.798218 22649 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260808 07:09:42.814122 22664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:42.814402 22649 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260808 07:09:42.814606 22649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7"
format_stamp: "Formatted at 2026-08-08 07:09:42 on dist-test-slave-77v9"
server_key: "e5bdd26ab8fc51f79fb6c1da7d5b721a"
server_key_iv: "f2ac9c5d5eca68822b278588ac00b59c"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:42.814743 22649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:42.843602 22649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:42.846931 22649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:42.847159 22649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:42.847582 22649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:42.848167 22649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:42.848228 22649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:42.848264 22649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:42.848292 22649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:42.871429 22649 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:35455
I20260808 07:09:42.871904 22649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:09:42.872937 22781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:35455 every 8 connection(s)
I20260808 07:09:42.873085 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 22649
I20260808 07:09:42.873250 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:09:42.873539 9592 external_mini_cluster.cc:1428] Setting key cf97f84092d67bddb59cebf057715830
Aug 08 07:09:42 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172982, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:42.883061 22503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:42.873230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:49387 (local address 127.9.94.62:41343)
0808 07:09:42.873282 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:42.873285 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:42.873516 (+ 231us) server_negotiation.cc:407] Connection header received
0808 07:09:42.874201 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:42.874202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:42.874215 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:42.874310 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:42.875026 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:42.875548 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:42.876570 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:42.876783 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:42.876904 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:42.879843 (+ 2939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:42.879844 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:42.879845 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:42.879853 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:42.881455 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:42.881901 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:42.881903 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:42.881903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:42.881971 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:42.882233 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:42.882234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:42.882234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:42.882356 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:42.882434 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:42.882793 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 07:09:42.882881 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:09:42.883247 22784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:42.872914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:41343 (local address 127.9.94.3:49387)
0808 07:09:42.873368 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:42.873425 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:42.874063 (+ 638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:42.874368 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:42.874371 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:42.874655 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:42.874940 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:42.874947 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:42.875655 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:42.875656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:42.876466 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:42.876468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:42.876932 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:42.876933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:42.877161 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:42.877844 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:42.877853 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:42.879736 (+ 1883us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:42.881544 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:42.881551 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:42.881553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:42.881805 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:42.882040 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:42.882040 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:42.882041 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:42.882155 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:42.882430 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:42.882437 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:42.882643 (+ 206us) client_negotiation.cc:769] Sending connection context
0808 07:09:42.882758 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 07:09:42.882928 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":83,"threads_started":1}
I20260808 07:09:42.883735 22782 heartbeater.cc:347] Connected to a master server at 127.9.94.62:41343
I20260808 07:09:42.883831 22782 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:42.883991 22782 heartbeater.cc:511] Master 127.9.94.62:41343 requested a full tablet report, sending...
I20260808 07:09:42.884382 22286 ts_manager.cc:194] Registered new tserver with Master: 4c2e5e8a1ec24e8698b93fede2a45ec7 (127.9.94.3:35455)
I20260808 07:09:42.884779 22286 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:49387
I20260808 07:09:42.886129 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:09:42.886833 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 22369
I20260808 07:09:42.895852 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 22509
I20260808 07:09:42.901831 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 22649
I20260808 07:09:42.908404 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 22253
I20260808 07:09:42.915872 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:41343
--webserver_interface=127.9.94.62
--webserver_port=42503
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:41343
--ranger_config_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.94.20:40459/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.94.20:40459/kms with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:43.004438 22785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:43.004669 22785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:43.004693 22785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:43.005910 22785 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:43.005959 22785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:43.005973 22785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:43.005986 22785 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:43.005998 22785 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:43.007663 22785 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.94.20:40459/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:41343
--ranger_config_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:41343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=42503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:43.007946 22785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:43.008203 22785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:43.014199 22791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:43.014269 22793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:43.014315 22785 server_base.cc:1034] running on GCE node
W20260808 07:09:43.014343 22790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:43.014786 22785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:43.015465 22785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:43.016683 22785 hybrid_clock.cc:648] HybridClock initialized: now 1786172983016654 us; error 83 us; skew 500 ppm
Aug 08 07:09:43 dist-test-slave-77v9 krb5kdc[21791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172983, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:43.019760 22785 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:09:43.020255 22785 webserver.cc:460] Webserver started at http://127.9.94.62:42503/ using document root <none> and password file <none>
I20260808 07:09:43.020532 22785 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:43.020592 22785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 07:09:43 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172983, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
I20260808 07:09:43.104585 22785 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:43.105723 22801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:43.106134 22785 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:43.106287 22785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "03d55429c3df4c74a9f41d5c2510352a"
format_stamp: "Formatted at 2026-08-08 07:09:41 on dist-test-slave-77v9"
server_key: "d03b78057384eec2d9c309d6ac14f4c4"
server_key_iv: "df0a8c878dfb4cf23acce882c8d21589"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:43.106755 22785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:43.119246 22785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:43.121806 22785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:43.122015 22785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:43.127161 22785 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:41343
I20260808 07:09:43.127188 22854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:41343 every 8 connection(s)
I20260808 07:09:43.127830 22785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:43.129554 22855 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:09:43.130460 22855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a: Bootstrap starting.
I20260808 07:09:43.134765 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 22785
I20260808 07:09:43.135136 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.94.20:40459/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:36083
--local_ip_for_outbound_sockets=127.9.94.1
--tserver_master_addrs=127.9.94.62:41343
--webserver_port=45633
--webserver_interface=127.9.94.1
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.94.20:40459/kms with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:09:43.140877 22855 log.cc:824] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:43.143775 22855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:09:43.144197 22855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a: Bootstrap complete.
I20260808 07:09:43.149515 22855 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d55429c3df4c74a9f41d5c2510352a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 41343 } }
I20260808 07:09:43.150019 22855 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03d55429c3df4c74a9f41d5c2510352a, State: Initialized, Role: FOLLOWER
I20260808 07:09:43.150234 22855 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d55429c3df4c74a9f41d5c2510352a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 41343 } }
I20260808 07:09:43.150328 22855 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:43.150398 22855 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:43.150461 22855 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:09:43.152036 22855 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d55429c3df4c74a9f41d5c2510352a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 41343 } }
I20260808 07:09:43.152163 22855 leader_election.cc:302] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03d55429c3df4c74a9f41d5c2510352a; no voters:
I20260808 07:09:43.152400 22855 leader_election.cc:288] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 07:09:43.152470 22860 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:09:43.152650 22860 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [term 2 LEADER]: Becoming Leader. State: Replica: 03d55429c3df4c74a9f41d5c2510352a, State: Running, Role: LEADER
I20260808 07:09:43.152678 22855 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:43.152757 22860 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d55429c3df4c74a9f41d5c2510352a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 41343 } }
I20260808 07:09:43.153072 22861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "03d55429c3df4c74a9f41d5c2510352a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d55429c3df4c74a9f41d5c2510352a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 41343 } } }
I20260808 07:09:43.153071 22860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03d55429c3df4c74a9f41d5c2510352a. Latest consensus state: current_term: 2 leader_uuid: "03d55429c3df4c74a9f41d5c2510352a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d55429c3df4c74a9f41d5c2510352a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 41343 } } }
I20260808 07:09:43.153180 22861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:43.153185 22860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:43.153687 22867 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:43.154273 22867 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:43.154466 22867 catalog_manager.cc:1259] Loaded cluster ID: f3f551d68d4d4c2eb63a5caa939ef8c0
I20260808 07:09:43.154560 22867 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:43.154688 22855 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 07:09:43.155594 22867 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:43.155804 22867 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a: Loaded TSK: 0
I20260808 07:09:43.156044 22867 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:09:43.239286 22857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:43.239617 22857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:43.239662 22857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:43.241798 22857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:43.241876 22857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:43.241932 22857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:09:43.244050 22857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.94.20:40459/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:36083
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=45633
--tserver_master_addrs=127.9.94.62:41343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:43.244347 22857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:43.244661 22857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:43.251242 22896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:43.251242 22893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:43.251657 22894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:43.252614 22857 server_base.cc:1034] running on GCE node
I20260808 07:09:43.253006 22857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:43.253382 22857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:43.254560 22857 hybrid_clock.cc:648] HybridClock initialized: now 1786172983254545 us; error 35 us; skew 500 ppm
Aug 08 07:09:43 dist-test-slave-77v9 krb5kdc[21791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172983, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:43.257925 22857 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:09:43.258525 22857 webserver.cc:460] Webserver started at http://127.9.94.1:45633/ using document root <none> and password file <none>
I20260808 07:09:43.258806 22857 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:43.258904 22857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 07:09:43 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172983, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
I20260808 07:09:43.289397 22857 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.001s sys 0.000s
I20260808 07:09:43.290670 22905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:43.290935 22857 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:43.291081 22857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "22bc333dca0c4ed1b4426c3dd164f2e2"
format_stamp: "Formatted at 2026-08-08 07:09:42 on dist-test-slave-77v9"
server_key: "844cdacac223cd3d9af784d31755961f"
server_key_iv: "d252026a0c66ec1001d4f45f4090e0f3"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:43.291548 22857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:43.309247 22857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:43.312968 22857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:43.313198 22857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:43.313540 22857 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:43.313935 22857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:43.313989 22857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:43.314033 22857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:43.314055 22857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:43.321357 22857 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:36083
I20260808 07:09:43.321944 22857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:09:43.322218 23021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:36083 every 8 connection(s)
I20260808 07:09:43.325982 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 22857
I20260808 07:09:43.326359 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.94.20:40459/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:41597
--local_ip_for_outbound_sockets=127.9.94.2
--tserver_master_addrs=127.9.94.62:41343
--webserver_port=36261
--webserver_interface=127.9.94.2
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.94.20:40459/kms with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:09:43 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172983, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:43.338778 23025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:43.322908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:41343 (local address 127.9.94.1:55197)
0808 07:09:43.323079 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:43.323124 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:43.323737 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:43.324313 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:43.324318 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:43.324552 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:43.324758 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:43.324762 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:43.327596 (+ 2834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:43.327598 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:43.329134 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:43.329138 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:43.329854 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:43.329856 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:43.330032 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:43.330781 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:43.330794 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:43.332856 (+ 2062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:43.336146 (+ 3290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:43.336160 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:43.336162 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:43.336600 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:43.337024 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:43.337025 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:43.337026 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:43.337201 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:43.337858 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:43.337866 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:43.338074 (+ 208us) client_negotiation.cc:769] Sending connection context
0808 07:09:43.338205 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 07:09:43.338427 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
I20260808 07:09:43.339638 23026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:43.323318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:55197 (local address 127.9.94.62:41343)
0808 07:09:43.323934 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:43.323942 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:43.323969 (+ 27us) server_negotiation.cc:407] Connection header received
0808 07:09:43.324086 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:43.324090 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:43.324128 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:43.324273 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:43.324936 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:43.327422 (+ 2486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:43.329255 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:43.329714 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:43.329876 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:43.333046 (+ 3170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:43.333052 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:43.333052 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:43.333067 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:43.335993 (+ 2926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:43.336724 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:43.336730 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:43.336730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:43.336909 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:43.337296 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:43.337297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:43.337298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:43.337716 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:43.337819 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:43.339157 (+ 1338us) server_negotiation.cc:299] Negotiation successful
0808 07:09:43.339310 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":108,"threads_started":1}
I20260808 07:09:43.340476 23023 heartbeater.cc:347] Connected to a master server at 127.9.94.62:41343
I20260808 07:09:43.340588 23023 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:43.340773 23023 heartbeater.cc:511] Master 127.9.94.62:41343 requested a full tablet report, sending...
W20260808 07:09:43.341815 23023 heartbeater.cc:644] Failed to heartbeat to 127.9.94.62:41343 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 07:09:43.341918 23023 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:43.342010 23023 heartbeater.cc:511] Master 127.9.94.62:41343 requested a full tablet report, sending...
I20260808 07:09:43.342402 23023 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:43.342504 23023 heartbeater.cc:511] Master 127.9.94.62:41343 requested a full tablet report, sending...
W20260808 07:09:43.342877 23023 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:09:43.460376 23027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:43.460719 23027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:43.460783 23027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:43.462440 23027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:43.462525 23027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:43.462579 23027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:09:43.464560 23027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.94.20:40459/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:41597
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=36261
--tserver_master_addrs=127.9.94.62:41343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:43.464923 23027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:43.465248 23027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:43.471926 23034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:43.472234 23027 server_base.cc:1034] running on GCE node
W20260808 07:09:43.472334 23036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:43.473381 23033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:43.473779 23027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:43.474095 23027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:43.475299 23027 hybrid_clock.cc:648] HybridClock initialized: now 1786172983475272 us; error 54 us; skew 500 ppm
Aug 08 07:09:43 dist-test-slave-77v9 krb5kdc[21791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172983, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:43.480048 23027 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:09:43.480650 23027 webserver.cc:460] Webserver started at http://127.9.94.2:36261/ using document root <none> and password file <none>
I20260808 07:09:43.480974 23027 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:43.481074 23027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 07:09:43 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172983, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
I20260808 07:09:43.502799 23027 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:43.504091 23044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:43.504313 23027 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:43.504424 23027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "8f34aa3289eb49e0a51ae9c62788a588"
format_stamp: "Formatted at 2026-08-08 07:09:42 on dist-test-slave-77v9"
server_key: "ae09a07ec03ede5605a05bd8eaed724b"
server_key_iv: "a7236e28c4c3fbf8765d9dee397538e5"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:43.505117 23027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:43.551364 23027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:43.554239 23027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:43.554440 23027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:43.554764 23027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:43.555218 23027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:43.555280 23027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:43.555316 23027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:43.555338 23027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:43.563529 23027 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:41597
I20260808 07:09:43.564073 23027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:09:43.564313 23160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:41597 every 8 connection(s)
I20260808 07:09:43.569834 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 23027
I20260808 07:09:43.570156 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.94.20:40459/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:35455
--local_ip_for_outbound_sockets=127.9.94.3
--tserver_master_addrs=127.9.94.62:41343
--webserver_port=46393
--webserver_interface=127.9.94.3
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.94.20:40459/kms with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:09:43 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172983, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:43.577086 23026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:43.565455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:33609 (local address 127.9.94.62:41343)
0808 07:09:43.565546 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:43.565548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:43.565634 (+ 86us) server_negotiation.cc:407] Connection header received
0808 07:09:43.566274 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:43.566276 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:43.566294 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:43.566364 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:43.567016 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:43.567577 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:43.568770 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:43.569191 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:43.569301 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:43.572225 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:43.572227 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:43.572227 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:43.572238 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:43.574778 (+ 2540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:43.575424 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:43.575425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:43.575426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:43.575501 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:43.575874 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:43.575875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:43.575875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:43.576071 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:43.576168 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:43.576860 (+ 692us) server_negotiation.cc:299] Negotiation successful
0808 07:09:43.576969 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 07:09:43.577740 23163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:43.565201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:41343 (local address 127.9.94.2:33609)
0808 07:09:43.565499 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:43.565548 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:43.566147 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:43.566465 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:43.566469 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:43.566670 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:43.566893 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:43.566903 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:43.567691 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:43.567692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:43.568640 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:43.568643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:43.569335 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:43.569337 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:43.569494 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:43.570205 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:43.570215 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:43.572072 (+ 1857us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:43.574907 (+ 2835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:43.574917 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:43.574920 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:43.575309 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:43.575598 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:43.575599 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:43.575600 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:43.575776 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:43.576163 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:43.576327 (+ 164us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:43.576599 (+ 272us) client_negotiation.cc:769] Sending connection context
0808 07:09:43.576770 (+ 171us) client_negotiation.cc:240] Negotiation successful
0808 07:09:43.577034 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":99,"threads_started":1}
I20260808 07:09:43.578501 23161 heartbeater.cc:347] Connected to a master server at 127.9.94.62:41343
I20260808 07:09:43.578629 23161 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:43.578866 23161 heartbeater.cc:511] Master 127.9.94.62:41343 requested a full tablet report, sending...
W20260808 07:09:43.579686 23161 heartbeater.cc:644] Failed to heartbeat to 127.9.94.62:41343 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 07:09:43.579773 23161 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:43.579859 23161 heartbeater.cc:511] Master 127.9.94.62:41343 requested a full tablet report, sending...
I20260808 07:09:43.580334 23161 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:43.580443 23161 heartbeater.cc:511] Master 127.9.94.62:41343 requested a full tablet report, sending...
W20260808 07:09:43.580906 23161 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:09:43.699891 23164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:43.700235 23164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:43.700281 23164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:43.702308 23164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:43.702376 23164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:43.702423 23164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:09:43.705017 23164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.94.20:40459/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:35455
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=46393
--tserver_master_addrs=127.9.94.62:41343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:43.705305 23164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:43.705592 23164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:43.713517 23171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:43.714277 23164 server_base.cc:1034] running on GCE node
W20260808 07:09:43.714532 23170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:43.716995 23173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:43.717440 23164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:43.717784 23164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:43.718969 23164 hybrid_clock.cc:648] HybridClock initialized: now 1786172983718940 us; error 48 us; skew 500 ppm
Aug 08 07:09:43 dist-test-slave-77v9 krb5kdc[21791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172983, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:43.722653 23164 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:09:43.723275 23164 webserver.cc:460] Webserver started at http://127.9.94.3:46393/ using document root <none> and password file <none>
I20260808 07:09:43.723608 23164 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:43.723696 23164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 07:09:43 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172983, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
I20260808 07:09:43.742976 23164 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.001s
I20260808 07:09:43.744318 23182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:43.744606 23164 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:43.744782 23164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7"
format_stamp: "Formatted at 2026-08-08 07:09:42 on dist-test-slave-77v9"
server_key: "e5bdd26ab8fc51f79fb6c1da7d5b721a"
server_key_iv: "f2ac9c5d5eca68822b278588ac00b59c"
server_key_version: "kuduclusterkey@0"
I20260808 07:09:43.745440 23164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:43.770999 23164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:43.773746 23164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:43.773943 23164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:43.774243 23164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:43.774732 23164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:43.774801 23164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:43.774837 23164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:43.774858 23164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:43.783380 23164 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:35455
I20260808 07:09:43.783591 23299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:35455 every 8 connection(s)
I20260808 07:09:43.783947 23164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:09:43.788695 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 23164
Aug 08 07:09:43 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172983, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:43.797700 23026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:43.785923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:44471 (local address 127.9.94.62:41343)
0808 07:09:43.785973 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:43.785976 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:43.785988 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:09:43.786745 (+ 757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:43.786747 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:43.786776 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:43.786812 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:43.787672 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:43.788405 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:43.790693 (+ 2288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:43.791018 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:43.791066 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:43.793922 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:43.793924 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:43.793924 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:43.793932 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:43.795897 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:43.796454 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:43.796455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:43.796456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:43.796523 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:43.796888 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:43.796889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:43.796889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:43.797035 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:43.797109 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:43.797493 (+ 384us) server_negotiation.cc:299] Negotiation successful
0808 07:09:43.797586 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:09:43.797892 23302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:43.785580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:41343 (local address 127.9.94.3:44471)
0808 07:09:43.785823 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:43.785878 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:43.786590 (+ 712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:43.787022 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:43.787028 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:43.787317 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:43.787551 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:43.787557 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:43.789071 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:43.789072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:43.790569 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:43.790573 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:43.791185 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:43.791186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:43.791343 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:43.792024 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:43.792036 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:43.793798 (+ 1762us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:43.795993 (+ 2195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:43.796000 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:43.796003 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:43.796352 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:43.796604 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:43.796605 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:43.796605 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:43.796748 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:43.797105 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:43.797112 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:43.797305 (+ 193us) client_negotiation.cc:769] Sending connection context
0808 07:09:43.797417 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 07:09:43.797582 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":110,"threads_started":1}
I20260808 07:09:43.798466 23300 heartbeater.cc:347] Connected to a master server at 127.9.94.62:41343
I20260808 07:09:43.798583 23300 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:43.798825 23300 heartbeater.cc:511] Master 127.9.94.62:41343 requested a full tablet report, sending...
W20260808 07:09:43.799623 23300 heartbeater.cc:644] Failed to heartbeat to 127.9.94.62:41343 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 07:09:43.799690 23300 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:43.799774 23300 heartbeater.cc:511] Master 127.9.94.62:41343 requested a full tablet report, sending...
I20260808 07:09:43.800123 23300 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:43.800200 23300 heartbeater.cc:511] Master 127.9.94.62:41343 requested a full tablet report, sending...
W20260808 07:09:43.800558 23300 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 07:09:43.800721 23303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:43.789246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37286 (local address 127.9.94.62:41343)
0808 07:09:43.789419 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:43.789421 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:43.789562 (+ 141us) server_negotiation.cc:407] Connection header received
0808 07:09:43.789680 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:43.789681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:43.789695 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:43.789740 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:43.790817 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:43.791994 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:43.794044 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:43.794768 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:43.794825 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:43.796763 (+ 1938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:43.796764 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:43.796765 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:43.796772 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:43.798876 (+ 2104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:43.799368 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:43.799369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:43.799370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:43.799434 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:43.800083 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:43.800084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:43.800084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:43.800216 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:43.800440 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:43.800493 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 07:09:43.800603 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":72,"threads_started":1}
I20260808 07:09:44.343127 23023 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:44.343405 23023 heartbeater.cc:511] Master 127.9.94.62:41343 requested a full tablet report, sending...
I20260808 07:09:44.343946 22819 ts_manager.cc:194] Registered new tserver with Master: 22bc333dca0c4ed1b4426c3dd164f2e2 (127.9.94.1:36083)
I20260808 07:09:44.344798 22819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:55197
Aug 08 07:09:44 dist-test-slave-77v9 krb5kdc[21791](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786172984, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:44.581107 23161 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:44.581284 23161 heartbeater.cc:511] Master 127.9.94.62:41343 requested a full tablet report, sending...
I20260808 07:09:44.581681 22817 ts_manager.cc:194] Registered new tserver with Master: 8f34aa3289eb49e0a51ae9c62788a588 (127.9.94.2:41597)
I20260808 07:09:44.582297 22817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:33609
I20260808 07:09:44.800733 23300 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:44.800956 23300 heartbeater.cc:511] Master 127.9.94.62:41343 requested a full tablet report, sending...
I20260808 07:09:44.801455 22817 ts_manager.cc:194] Registered new tserver with Master: 4c2e5e8a1ec24e8698b93fede2a45ec7 (127.9.94.3:35455)
I20260808 07:09:44.802042 22817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:44471
I20260808 07:09:44.803644 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:09:44.813548 23322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:44.804643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37296 (local address 127.9.94.62:41343)
0808 07:09:44.804777 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:44.804780 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:44.804857 (+ 77us) server_negotiation.cc:407] Connection header received
0808 07:09:44.804925 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:44.804925 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:44.804937 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:44.804995 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:44.805586 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.806087 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.806833 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.807059 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.807138 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:44.808558 (+ 1420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:44.808559 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:44.808560 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:44.808567 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:44.811982 (+ 3415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:44.812438 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:44.812440 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:44.812440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:44.812514 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:44.812763 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:44.812764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:44.812764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:44.812958 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:44.813080 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:44.813199 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 07:09:44.813303 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
I20260808 07:09:44.816047 22817 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37296:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:09:44.818248 22817 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:09:44.837555 23331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:44.826992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:35455 (local address 127.0.0.1:42380)
0808 07:09:44.832459 (+ 5467us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:44.832545 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:44.832658 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:44.833029 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:44.833033 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:44.833035 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:44.833137 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:44.833140 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.834669 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.834670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:44.836073 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:44.836076 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.837222 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.837223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:44.837310 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:44.837325 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 07:09:44.837402 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 07:09:44.837454 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5426,"thread_start_us":97,"threads_started":1}
I20260808 07:09:44.837950 23330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:44.827106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42380 (local address 127.9.94.3:35455)
0808 07:09:44.832371 (+ 5265us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:44.832377 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:44.832633 (+ 256us) server_negotiation.cc:407] Connection header received
0808 07:09:44.832750 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:44.832753 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:44.832781 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:44.832907 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:44.833239 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.834560 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.836178 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.837045 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.837116 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:44.837181 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:44.837823 (+ 642us) server_negotiation.cc:299] Negotiation successful
0808 07:09:44.837869 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5216,"thread_start_us":65,"threads_started":1}
I20260808 07:09:44.838819 23233 tablet_service.cc:1467] Processing CreateTablet for tablet 6be1e616d87e490e8e28ce6ca4132a19 (DEFAULT_TABLE table=test-table [id=932f1ac6155740dd9f93d5c61e14e989]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:44.839232 23233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6be1e616d87e490e8e28ce6ca4132a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:44.843748 23329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:44.826992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:41597 (local address 127.0.0.1:56108)
0808 07:09:44.832794 (+ 5802us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:44.832839 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:44.832892 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:44.833788 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:44.833788 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:44.833789 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:44.833818 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:44.833819 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.839581 (+ 5762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.839582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:44.840787 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:44.840790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.843450 (+ 2660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.843451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:44.843518 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:44.843521 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:09:44.843612 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 07:09:44.843656 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5783,"mutex_wait_us":2,"thread_start_us":92,"threads_started":1}
I20260808 07:09:44.843767 23333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:44.827516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56108 (local address 127.9.94.2:41597)
0808 07:09:44.827652 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:44.827658 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:44.833094 (+ 5436us) server_negotiation.cc:407] Connection header received
0808 07:09:44.833139 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:44.833142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:44.833161 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:44.833247 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:44.836915 (+ 3668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.839471 (+ 2556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.840931 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.841786 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.841866 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:44.841927 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:44.843632 (+ 1705us) server_negotiation.cc:299] Negotiation successful
0808 07:09:44.843681 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":70,"threads_started":1}
I20260808 07:09:44.844487 23328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:44.827248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:36083 (local address 127.0.0.1:60162)
0808 07:09:44.832979 (+ 5731us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:44.832990 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:44.833374 (+ 384us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:44.833685 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:44.833686 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:44.833688 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:44.833729 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:44.833731 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.835540 (+ 1809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.835540 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:44.836769 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:44.836771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.844218 (+ 7447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.844219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:44.844268 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:44.844271 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:09:44.844354 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 07:09:44.844403 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5716,"thread_start_us":83,"threads_started":1}
I20260808 07:09:44.844535 23332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:44.827371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60162 (local address 127.9.94.1:36083)
0808 07:09:44.827761 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:44.827765 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:44.833053 (+ 5288us) server_negotiation.cc:407] Connection header received
0808 07:09:44.833487 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:44.833491 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:44.833507 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:44.833564 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:44.833910 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.835440 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.842003 (+ 6563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.843301 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.843355 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:44.843412 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:44.844391 (+ 979us) server_negotiation.cc:299] Negotiation successful
0808 07:09:44.844439 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":58,"threads_started":1}
I20260808 07:09:44.845356 23094 tablet_service.cc:1467] Processing CreateTablet for tablet 6be1e616d87e490e8e28ce6ca4132a19 (DEFAULT_TABLE table=test-table [id=932f1ac6155740dd9f93d5c61e14e989]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:44.845646 23094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6be1e616d87e490e8e28ce6ca4132a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:44.845600 22943 tablet_service.cc:1467] Processing CreateTablet for tablet 6be1e616d87e490e8e28ce6ca4132a19 (DEFAULT_TABLE table=test-table [id=932f1ac6155740dd9f93d5c61e14e989]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:44.845984 22943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6be1e616d87e490e8e28ce6ca4132a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:44.849131 23335 tablet_bootstrap.cc:492] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588: Bootstrap starting.
I20260808 07:09:44.849757 23334 tablet_bootstrap.cc:492] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7: Bootstrap starting.
I20260808 07:09:44.849962 23335 tablet_bootstrap.cc:654] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:44.850989 23335 log.cc:824] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:44.851261 23334 tablet_bootstrap.cc:654] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:44.851620 23334 log.cc:824] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:44.852056 23336 tablet_bootstrap.cc:492] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2: Bootstrap starting.
I20260808 07:09:44.852658 23336 tablet_bootstrap.cc:654] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:44.853072 23336 log.cc:824] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:44.853735 23334 tablet_bootstrap.cc:492] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7: No bootstrap required, opened a new log
I20260808 07:09:44.853835 23334 ts_tablet_manager.cc:1397] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 07:09:44.856918 23334 raft_consensus.cc:348] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34aa3289eb49e0a51ae9c62788a588" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41597 } } peers { permanent_uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35455 } } peers { permanent_uuid: "22bc333dca0c4ed1b4426c3dd164f2e2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36083 } }
I20260808 07:09:44.857156 23334 raft_consensus.cc:374] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:44.857206 23334 raft_consensus.cc:729] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c2e5e8a1ec24e8698b93fede2a45ec7, State: Initialized, Role: FOLLOWER
I20260808 07:09:44.857738 23336 tablet_bootstrap.cc:492] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2: No bootstrap required, opened a new log
I20260808 07:09:44.857843 23336 ts_tablet_manager.cc:1397] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260808 07:09:44.859445 23335 tablet_bootstrap.cc:492] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588: No bootstrap required, opened a new log
I20260808 07:09:44.859534 23335 ts_tablet_manager.cc:1397] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260808 07:09:44.860752 23334 consensus_queue.cc:260] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34aa3289eb49e0a51ae9c62788a588" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41597 } } peers { permanent_uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35455 } } peers { permanent_uuid: "22bc333dca0c4ed1b4426c3dd164f2e2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36083 } }
I20260808 07:09:44.861140 23334 ts_tablet_manager.cc:1428] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260808 07:09:44.861299 23300 heartbeater.cc:503] Master 127.9.94.62:41343 was elected leader, sending a full tablet report...
I20260808 07:09:44.862984 23335 raft_consensus.cc:348] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34aa3289eb49e0a51ae9c62788a588" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41597 } } peers { permanent_uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35455 } } peers { permanent_uuid: "22bc333dca0c4ed1b4426c3dd164f2e2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36083 } }
I20260808 07:09:44.862967 23336 raft_consensus.cc:348] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34aa3289eb49e0a51ae9c62788a588" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41597 } } peers { permanent_uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35455 } } peers { permanent_uuid: "22bc333dca0c4ed1b4426c3dd164f2e2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36083 } }
I20260808 07:09:44.863168 23336 raft_consensus.cc:374] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:44.863216 23336 raft_consensus.cc:729] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22bc333dca0c4ed1b4426c3dd164f2e2, State: Initialized, Role: FOLLOWER
I20260808 07:09:44.863302 23335 raft_consensus.cc:374] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:44.863401 23335 raft_consensus.cc:729] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f34aa3289eb49e0a51ae9c62788a588, State: Initialized, Role: FOLLOWER
I20260808 07:09:44.863389 23336 consensus_queue.cc:260] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34aa3289eb49e0a51ae9c62788a588" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41597 } } peers { permanent_uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35455 } } peers { permanent_uuid: "22bc333dca0c4ed1b4426c3dd164f2e2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36083 } }
I20260808 07:09:44.863621 23335 consensus_queue.cc:260] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34aa3289eb49e0a51ae9c62788a588" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41597 } } peers { permanent_uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35455 } } peers { permanent_uuid: "22bc333dca0c4ed1b4426c3dd164f2e2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36083 } }
I20260808 07:09:44.863765 23336 ts_tablet_manager.cc:1428] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260808 07:09:44.864028 23023 heartbeater.cc:503] Master 127.9.94.62:41343 was elected leader, sending a full tablet report...
I20260808 07:09:44.864168 23335 ts_tablet_manager.cc:1428] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260808 07:09:44.864351 23161 heartbeater.cc:503] Master 127.9.94.62:41343 was elected leader, sending a full tablet report...
Aug 08 07:09:44 dist-test-slave-77v9 krb5kdc[21791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172984, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for HTTP/127.9.94.20@KRBTEST.COM
I20260808 07:09:44.988147 23342 raft_consensus.cc:482] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:44.988356 23342 raft_consensus.cc:504] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34aa3289eb49e0a51ae9c62788a588" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41597 } } peers { permanent_uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35455 } } peers { permanent_uuid: "22bc333dca0c4ed1b4426c3dd164f2e2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36083 } }
I20260808 07:09:44.988873 23342 leader_election.cc:288] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f34aa3289eb49e0a51ae9c62788a588 (127.9.94.2:41597), 4c2e5e8a1ec24e8698b93fede2a45ec7 (127.9.94.3:35455)
I20260808 07:09:44.993588 23333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:44.989384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:60977 (local address 127.9.94.2:41597)
0808 07:09:44.989473 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:44.989475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:44.990041 (+ 566us) server_negotiation.cc:407] Connection header received
0808 07:09:44.990150 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:44.990151 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:44.990165 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:44.990194 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:44.990420 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.991142 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.992559 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.993180 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.993230 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:44.993241 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:44.993471 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 07:09:44.993512 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 07:09:44.993840 23344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:44.989145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:41597 (local address 127.9.94.1:60977)
0808 07:09:44.989959 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:44.989971 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:44.990073 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:44.990264 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:44.990264 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:44.990266 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:44.990345 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:44.990347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.991248 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.991249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:44.992457 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:44.992459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.993313 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.993314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:44.993392 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:44.993396 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:44.993692 (+ 296us) client_negotiation.cc:240] Negotiation successful
0808 07:09:44.993735 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":798,"thread_start_us":107,"threads_started":1}
I20260808 07:09:44.994210 23115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6be1e616d87e490e8e28ce6ca4132a19" candidate_uuid: "22bc333dca0c4ed1b4426c3dd164f2e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34aa3289eb49e0a51ae9c62788a588" is_pre_election: true
I20260808 07:09:44.994269 23330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:44.989375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:40071 (local address 127.9.94.3:35455)
0808 07:09:44.989428 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:44.989430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:44.990042 (+ 612us) server_negotiation.cc:407] Connection header received
0808 07:09:44.990157 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:44.990159 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:44.990172 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:44.990203 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:44.990470 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.991172 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.992597 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.993337 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.993398 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:44.993410 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:44.994123 (+ 713us) server_negotiation.cc:299] Negotiation successful
0808 07:09:44.994177 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 07:09:44.994392 23115 raft_consensus.cc:2454] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22bc333dca0c4ed1b4426c3dd164f2e2 in term 0.
I20260808 07:09:44.994632 22907 leader_election.cc:302] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22bc333dca0c4ed1b4426c3dd164f2e2, 8f34aa3289eb49e0a51ae9c62788a588; no voters:
I20260808 07:09:44.994766 23342 raft_consensus.cc:2781] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:09:44.994824 23342 raft_consensus.cc:482] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:09:44.994951 23345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:44.989139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:35455 (local address 127.9.94.1:40071)
0808 07:09:44.989952 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:44.989966 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:44.990075 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:44.990311 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:44.990312 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:44.990314 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:44.990385 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:44.990387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.991292 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.991293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:44.992489 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:44.992492 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.993499 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.993500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:44.993592 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:44.993596 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:44.994646 (+ 1050us) client_negotiation.cc:240] Negotiation successful
0808 07:09:44.994768 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":783,"thread_start_us":119,"threads_started":1}
I20260808 07:09:44.994966 23342 raft_consensus.cc:3037] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:44.995544 23253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6be1e616d87e490e8e28ce6ca4132a19" candidate_uuid: "22bc333dca0c4ed1b4426c3dd164f2e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7" is_pre_election: true
I20260808 07:09:44.995698 23253 raft_consensus.cc:2454] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22bc333dca0c4ed1b4426c3dd164f2e2 in term 0.
I20260808 07:09:44.996387 23342 raft_consensus.cc:504] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34aa3289eb49e0a51ae9c62788a588" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41597 } } peers { permanent_uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35455 } } peers { permanent_uuid: "22bc333dca0c4ed1b4426c3dd164f2e2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36083 } }
I20260808 07:09:44.996526 23342 leader_election.cc:288] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [CANDIDATE]: Term 1 election: Requested vote from peers 8f34aa3289eb49e0a51ae9c62788a588 (127.9.94.2:41597), 4c2e5e8a1ec24e8698b93fede2a45ec7 (127.9.94.3:35455)
I20260808 07:09:44.996731 23253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6be1e616d87e490e8e28ce6ca4132a19" candidate_uuid: "22bc333dca0c4ed1b4426c3dd164f2e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7"
I20260808 07:09:44.996840 23253 raft_consensus.cc:3037] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:44.996793 23115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6be1e616d87e490e8e28ce6ca4132a19" candidate_uuid: "22bc333dca0c4ed1b4426c3dd164f2e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34aa3289eb49e0a51ae9c62788a588"
I20260808 07:09:44.996917 23115 raft_consensus.cc:3037] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:44.997689 23253 raft_consensus.cc:2454] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22bc333dca0c4ed1b4426c3dd164f2e2 in term 1.
I20260808 07:09:44.997936 22909 leader_election.cc:302] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22bc333dca0c4ed1b4426c3dd164f2e2, 4c2e5e8a1ec24e8698b93fede2a45ec7; no voters:
I20260808 07:09:44.997951 23115 raft_consensus.cc:2454] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22bc333dca0c4ed1b4426c3dd164f2e2 in term 1.
I20260808 07:09:44.998013 23342 raft_consensus.cc:2781] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:44.998162 23342 raft_consensus.cc:686] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [term 1 LEADER]: Becoming Leader. State: Replica: 22bc333dca0c4ed1b4426c3dd164f2e2, State: Running, Role: LEADER
I20260808 07:09:44.998255 23342 consensus_queue.cc:237] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34aa3289eb49e0a51ae9c62788a588" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41597 } } peers { permanent_uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35455 } } peers { permanent_uuid: "22bc333dca0c4ed1b4426c3dd164f2e2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36083 } }
I20260808 07:09:44.999155 22819 catalog_manager.cc:5495] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22bc333dca0c4ed1b4426c3dd164f2e2 (127.9.94.1). New cstate: current_term: 1 leader_uuid: "22bc333dca0c4ed1b4426c3dd164f2e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34aa3289eb49e0a51ae9c62788a588" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22bc333dca0c4ed1b4426c3dd164f2e2" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 36083 } health_report { overall_health: HEALTHY } } }
I20260808 07:09:45.017954 23332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:45.013811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60168 (local address 127.9.94.1:36083)
0808 07:09:45.013875 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:45.013878 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:45.013925 (+ 47us) server_negotiation.cc:407] Connection header received
0808 07:09:45.014078 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:45.014079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:45.014105 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:45.014189 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:09:45.014378 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:45.015174 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:45.016452 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:45.016741 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:45.016865 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:45.017354 (+ 489us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:09:45.017500 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:09:45.017597 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:45.017841 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 07:09:45.017868 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 07:09:45.020385 23253 raft_consensus.cc:1261] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7 [term 1 FOLLOWER]: Refusing update from remote peer 22bc333dca0c4ed1b4426c3dd164f2e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:45.020386 23115 raft_consensus.cc:1261] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588 [term 1 FOLLOWER]: Refusing update from remote peer 22bc333dca0c4ed1b4426c3dd164f2e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:45.020798 23342 consensus_queue.cc:1035] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c2e5e8a1ec24e8698b93fede2a45ec7" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:45.021019 23342 consensus_queue.cc:1035] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34aa3289eb49e0a51ae9c62788a588" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:45.029892 23353 mvcc.cc:205] Tried to move back new op lower bound from 7316164546640420864 to 7316164546553430016. Current Snapshot: MvccSnapshot[applied={T|T < 7316164546640420864}]
I20260808 07:09:45.031087 22817 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:45.031222 22817 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:45.032006 22817 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 03d55429c3df4c74a9f41d5c2510352a: Sending DeleteTablet for 3 replicas of tablet 6be1e616d87e490e8e28ce6ca4132a19
I20260808 07:09:45.032426 23094 tablet_service.cc:1514] Processing DeleteTablet for tablet 6be1e616d87e490e8e28ce6ca4132a19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:45 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:56108
I20260808 07:09:45.032541 23233 tablet_service.cc:1514] Processing DeleteTablet for tablet 6be1e616d87e490e8e28ce6ca4132a19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:45 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:42380
I20260808 07:09:45.032795 22943 tablet_service.cc:1514] Processing DeleteTablet for tablet 6be1e616d87e490e8e28ce6ca4132a19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:45 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:60162
I20260808 07:09:45.032855 23361 tablet_replica.cc:330] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7: stopping tablet replica
I20260808 07:09:45.033037 23361 raft_consensus.cc:2229] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:45.033146 23362 tablet_replica.cc:330] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2: stopping tablet replica
I20260808 07:09:45.033242 23361 raft_consensus.cc:2258] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:45.033253 23362 raft_consensus.cc:2229] T 6be1e616d87e490e8e28ce6ca4132a19 P 22bc333dca0c4ed1b4426c3dd164f2e2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:09:45.033352 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 22857
I20260808 07:09:45.034529 23360 tablet_replica.cc:330] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588: stopping tablet replica
I20260808 07:09:45.034670 23360 raft_consensus.cc:2229] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:45.034736 23360 raft_consensus.cc:2258] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:45.039451 23361 ts_tablet_manager.cc:1905] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:45.041857 23361 ts_tablet_manager.cc:1918] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:45.041963 23361 log.cc:1196] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/6be1e616d87e490e8e28ce6ca4132a19
I20260808 07:09:45.042542 23361 ts_tablet_manager.cc:1939] T 6be1e616d87e490e8e28ce6ca4132a19 P 4c2e5e8a1ec24e8698b93fede2a45ec7: Deleting consensus metadata
I20260808 07:09:45.042800 23360 ts_tablet_manager.cc:1905] T 6be1e616d87e490e8e28ce6ca4132a19 P 8f34aa3289eb49e0a51ae9c62788a588: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:45.043063 22805 catalog_manager.cc:4841] TS 4c2e5e8a1ec24e8698b93fede2a45ec7 (127.9.94.3:35455): tablet 6be1e616d87e490e8e28ce6ca4132a19 (table test-table [id=932f1ac6155740dd9f93d5c61e14e989]) successfully deleted
W20260808 07:09:45.043323 22803 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:36083 (error 108)
I20260808 07:09:45.043744 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 23027
I20260808 07:09:45.048424 23328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:45.048239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:36083 (local address 127.0.0.1:60178)
0808 07:09:45.048316 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:45.048368 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:36083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 07:09:45.048573 22803 catalog_manager.cc:4584] TS 22bc333dca0c4ed1b4426c3dd164f2e2 (127.9.94.1:36083): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6be1e616d87e490e8e28ce6ca4132a19: Network error: Client connection negotiation failed: client connection to 127.9.94.1:36083: connect: Connection refused (error 111)
I20260808 07:09:45.053273 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 23164
I20260808 07:09:45.053361 23328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:45.053199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:41597 (local address 127.0.0.1:56120)
0808 07:09:45.053266 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:45.053308 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.2:41597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 07:09:45.060498 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 22785
I20260808 07:09:45.068578 9592 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 07:09:45.414286 9592 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 07:09:45.414405 9592 mini_ranger.cc:66] Stopping Ranger...
I20260808 07:09:45.770838 9592 mini_ranger.cc:68] Stopped Ranger
2026-08-08 07:09:45.771 UTC [21821] LOG: received smart shutdown request
2026-08-08 07:09:45.775 UTC [21821] LOG: background worker "logical replication launcher" (PID 21831) exited with exit code 1
2026-08-08 07:09:45.776 UTC [21825] LOG: shutting down
2026-08-08 07:09:46.009 UTC [21821] LOG: database system is shut down
2026-08-08T07:09:46Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (54907 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:46 dist-test-slave-77v9 krb5kdc[23373](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:46 dist-test-slave-77v9 krb5kdc[23373](info): set up 2 sockets
Aug 08 07:09:46 dist-test-slave-77v9 krb5kdc[23373](info): commencing operation
krb5kdc: starting...
W20260808 07:09:47.321579 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:09:47 dist-test-slave-77v9 krb5kdc[23373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:09:47.476284 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:42713
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:42713,127.9.94.61:42235,127.9.94.60:38713
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:47.572227 23386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:47.572479 23386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:47.572506 23386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:47.573814 23386 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:47.573873 23386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:47.573889 23386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:47.573902 23386 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:47.573915 23386 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:47.575598 23386 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:42713,127.9.94.61:42235,127.9.94.60:38713
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:42713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:47.575865 23386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:47.576061 23386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:47.581609 23393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:47.581609 23396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:47.581645 23394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:47.582073 23386 server_base.cc:1034] running on GCE node
I20260808 07:09:47.582311 23386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:47.582617 23386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:47.583779 23386 hybrid_clock.cc:648] HybridClock initialized: now 1786172987583729 us; error 68 us; skew 500 ppm
Aug 08 07:09:47 dist-test-slave-77v9 krb5kdc[23373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:47.586757 23386 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:09:47.587221 23386 webserver.cc:460] Webserver started at http://127.9.94.62:43845/ using document root <none> and password file <none>
I20260808 07:09:47.587466 23386 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:47.587517 23386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:47.587618 23386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:47.588783 23386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "a21e34752a874c3b845c3b17e7e50d10"
format_stamp: "Formatted at 2026-08-08 07:09:47 on dist-test-slave-77v9"
server_key: "45307ca6a4d8b69024779424a0197af8"
server_key_iv: "cb45447cc056ab59e04ad89e4cff295e"
server_key_version: "encryptionkey@0"
I20260808 07:09:47.589226 23386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "a21e34752a874c3b845c3b17e7e50d10"
format_stamp: "Formatted at 2026-08-08 07:09:47 on dist-test-slave-77v9"
server_key: "45307ca6a4d8b69024779424a0197af8"
server_key_iv: "cb45447cc056ab59e04ad89e4cff295e"
server_key_version: "encryptionkey@0"
I20260808 07:09:47.590731 23386 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:09:47.591619 23403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:47.591922 23386 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:47.592031 23386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "a21e34752a874c3b845c3b17e7e50d10"
format_stamp: "Formatted at 2026-08-08 07:09:47 on dist-test-slave-77v9"
server_key: "45307ca6a4d8b69024779424a0197af8"
server_key_iv: "cb45447cc056ab59e04ad89e4cff295e"
server_key_version: "encryptionkey@0"
I20260808 07:09:47.592147 23386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:47.619700 23386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:47.622117 23386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:47.622298 23386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:47.626726 23386 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:42713
I20260808 07:09:47.626758 23457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:42713 every 8 connection(s)
I20260808 07:09:47.627141 23386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:47.628053 23458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:47.629799 23458 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:09:47.633787 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 23386
I20260808 07:09:47.633991 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:09:47.634197 9592 external_mini_cluster.cc:1428] Setting key 6f1a568c8ef29cba0e5dbe0e8a3350d2
Aug 08 07:09:47 dist-test-slave-77v9 krb5kdc[23373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:47.641708 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.630685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:42713 (local address 127.0.0.1:51682)
0808 07:09:47.630953 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.630989 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:47.631474 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:47.631796 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:47.631799 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:47.632112 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:47.632266 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:47.632270 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.633428 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.633429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:47.634369 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:47.634372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.635054 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.635054 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:47.635119 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:47.635741 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:47.635749 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:47.637633 (+ 1884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:47.639959 (+ 2326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:47.639966 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:47.639968 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:47.640169 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:47.640518 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:47.640519 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:47.640519 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:47.640635 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:47.641243 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:47.641250 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:47.641314 (+ 64us) client_negotiation.cc:769] Sending connection context
0808 07:09:47.641399 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 07:09:47.641534 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":102,"threads_started":1}
I20260808 07:09:47.641794 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.630707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51682 (local address 127.9.94.62:42713)
0808 07:09:47.630974 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:47.630982 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:47.631092 (+ 110us) server_negotiation.cc:407] Connection header received
0808 07:09:47.631659 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:47.631661 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:47.631679 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:47.631762 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:47.632372 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.633298 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.634464 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.634952 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.635081 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:47.637728 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:47.637737 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:47.637737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:47.637745 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:47.639842 (+ 2097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:47.640286 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:47.640290 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:47.640290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:47.640415 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:47.640742 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:47.640743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:47.640743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:47.641121 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:47.641218 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:47.641464 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 07:09:47.641646 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":237,"thread_start_us":100,"threads_started":1}
I20260808 07:09:47.642663 23458 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:09:47.643230 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.643068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:42235 (local address 127.0.0.1:56164)
0808 07:09:47.643146 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.643205 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 07:09:47.643392 23404 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.94.61:42235: connect: Connection refused (error 111)
I20260808 07:09:47.643909 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.643789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:42235 (local address 127.0.0.1:56166)
0808 07:09:47.643855 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.643889 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
WARNING: no policy specified for kudu/127.9.94.61@KRBTEST.COM; defaulting to no policy
W20260808 07:09:47.644049 23458 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.61:42235: Network error: Client connection negotiation failed: client connection to 127.9.94.61:42235: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.61.keytab.
Entry for principal kudu/127.9.94.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.61.keytab.
I20260808 07:09:47.665608 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.61:42235
--webserver_interface=127.9.94.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.61.keytab
--principal=kudu/127.9.94.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:42713,127.9.94.61:42235,127.9.94.60:38713
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:09:47.693279 23458 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } attempt: 1
I20260808 07:09:47.693825 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.693688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:42235 (local address 127.0.0.1:56178)
0808 07:09:47.693755 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.693788 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 07:09:47.694142 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.694056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:42235 (local address 127.0.0.1:56194)
0808 07:09:47.694102 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.694123 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 07:09:47.694223 23458 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.61:42235: Network error: Client connection negotiation failed: client connection to 127.9.94.61:42235: connect: Connection refused (error 111)
I20260808 07:09:47.762429 23458 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } attempt: 2
I20260808 07:09:47.763011 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.762841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:42235 (local address 127.0.0.1:56198)
0808 07:09:47.762921 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.762971 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 07:09:47.763705 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.763572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:42235 (local address 127.0.0.1:56206)
0808 07:09:47.763636 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.763676 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 07:09:47.763928 23458 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.61:42235: Network error: Client connection negotiation failed: client connection to 127.9.94.61:42235: connect: Connection refused (error 111)
W20260808 07:09:47.770740 23465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:47.771070 23465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:47.771119 23465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:47.772650 23465 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:47.772748 23465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:47.772778 23465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:47.773001 23465 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:47.773056 23465 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:47.774909 23465 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:42713,127.9.94.61:42235,127.9.94.60:38713
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.61.keytab
--principal=kudu/127.9.94.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.61:42235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.94.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:47.775260 23465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:47.775535 23465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:47.781229 23473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:47.781268 23471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:47.781232 23470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:47.781721 23465 server_base.cc:1034] running on GCE node
I20260808 07:09:47.782034 23465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:47.782369 23465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:47.783558 23465 hybrid_clock.cc:648] HybridClock initialized: now 1786172987783500 us; error 86 us; skew 500 ppm
Aug 08 07:09:47 dist-test-slave-77v9 krb5kdc[23373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:47.790707 23465 init.cc:377] Logged in from keytab as kudu/127.9.94.61@KRBTEST.COM (short username kudu)
I20260808 07:09:47.791280 23465 webserver.cc:460] Webserver started at http://127.9.94.61:32795/ using document root <none> and password file <none>
I20260808 07:09:47.791576 23465 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:47.791656 23465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:47.791836 23465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:47.793195 23465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/data/instance:
uuid: "657d34f752ec464facf3b8a4ec090a49"
format_stamp: "Formatted at 2026-08-08 07:09:47 on dist-test-slave-77v9"
server_key: "6edc36c6ce95581de9ccf4c340720f92"
server_key_iv: "01cc803d87b604b6e10fb7d5436f47fb"
server_key_version: "encryptionkey@0"
I20260808 07:09:47.793612 23465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/wal/instance:
uuid: "657d34f752ec464facf3b8a4ec090a49"
format_stamp: "Formatted at 2026-08-08 07:09:47 on dist-test-slave-77v9"
server_key: "6edc36c6ce95581de9ccf4c340720f92"
server_key_iv: "01cc803d87b604b6e10fb7d5436f47fb"
server_key_version: "encryptionkey@0"
I20260808 07:09:47.795171 23465 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:09:47.796283 23480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:47.796640 23465 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:47.796886 23465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/wal
uuid: "657d34f752ec464facf3b8a4ec090a49"
format_stamp: "Formatted at 2026-08-08 07:09:47 on dist-test-slave-77v9"
server_key: "6edc36c6ce95581de9ccf4c340720f92"
server_key_iv: "01cc803d87b604b6e10fb7d5436f47fb"
server_key_version: "encryptionkey@0"
I20260808 07:09:47.797008 23465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:47.818648 23465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:47.821198 23465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:47.821390 23465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:47.825699 23465 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.61:42235
I20260808 07:09:47.825742 23537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.61:42235 every 8 connection(s)
I20260808 07:09:47.826144 23465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/data/info.pb
I20260808 07:09:47.827080 23538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:47.828748 23538 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:09:47.833801 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 23465
I20260808 07:09:47.833909 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-1/wal/instance
I20260808 07:09:47.834147 9592 external_mini_cluster.cc:1428] Setting key 44f61cece4bf7237c3e6dee96a5825b8
Aug 08 07:09:47 dist-test-slave-77v9 krb5kdc[23373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.61@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:47.839241 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.829617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51694 (local address 127.9.94.62:42713)
0808 07:09:47.829698 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:47.829700 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:47.829944 (+ 244us) server_negotiation.cc:407] Connection header received
0808 07:09:47.830375 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:47.830376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:47.830391 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:47.830473 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:47.831141 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.831706 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.832877 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.833105 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.833179 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:47.835877 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:47.835879 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:47.835879 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:47.835889 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:47.837481 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:47.838083 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:47.838084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:47.838084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:47.838145 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:47.838493 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:47.838493 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:47.838494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:47.838611 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:47.838666 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:47.839077 (+ 411us) server_negotiation.cc:299] Negotiation successful
0808 07:09:47.839171 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 07:09:47.839534 23540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.829527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:42713 (local address 127.0.0.1:51694)
0808 07:09:47.829720 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.829764 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:47.830280 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:47.830536 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:47.830539 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:47.830846 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:47.831048 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:47.831052 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.831821 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.831822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:47.832720 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:47.832722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.833202 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.833203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:47.833335 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:47.834034 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:47.834047 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:47.835772 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:47.837582 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:47.837590 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:47.837593 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:47.837989 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:47.838228 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:47.838229 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:47.838230 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:47.838409 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:47.838686 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:47.838694 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:47.838908 (+ 214us) client_negotiation.cc:769] Sending connection context
0808 07:09:47.839051 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 07:09:47.839252 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":115,"threads_started":1}
I20260808 07:09:47.840337 23538 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.9.94.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.60@KRBTEST.COM" created.
Aug 08 07:09:47 dist-test-slave-77v9 krb5kdc[23373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.61@KRBTEST.COM for kudu/127.9.94.61@KRBTEST.COM
I20260808 07:09:47.850692 23542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.840761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56210 (local address 127.9.94.61:42235)
0808 07:09:47.841015 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:47.841020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:47.841037 (+ 17us) server_negotiation.cc:407] Connection header received
0808 07:09:47.841056 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:47.841058 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:47.841070 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:47.841159 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:47.841460 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.842224 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.842982 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.843303 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.843399 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:47.847349 (+ 3950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:47.847359 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:47.847359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:47.847367 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:47.849243 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:47.849684 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:47.849687 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:47.849687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:47.849748 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:47.850002 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:47.850003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:47.850003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:47.850167 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:47.850264 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:47.850467 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 07:09:47.850565 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":213,"thread_start_us":154,"threads_started":1}
I20260808 07:09:47.850714 23540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.840674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:42235 (local address 127.0.0.1:56210)
0808 07:09:47.840751 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.840761 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:47.840798 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:47.841159 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:47.841160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:47.841323 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:47.841376 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:47.841378 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.842326 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.842327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:47.842876 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:47.842878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.843393 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.843394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:47.843472 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:47.843977 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:47.843981 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:47.847256 (+ 3275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:47.849336 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:47.849337 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:47.849337 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:47.849579 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:47.849830 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:47.849831 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:47.849831 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:47.849910 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:47.850258 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:47.850259 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:47.850312 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 07:09:47.850390 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 07:09:47.850515 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 07:09:47.851588 23538 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:09:47.852061 23540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.851892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:38713 (local address 127.0.0.1:58360)
0808 07:09:47.851961 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.852024 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 07:09:47.852257 23481 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
I20260808 07:09:47.852963 23540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.852775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:38713 (local address 127.0.0.1:58364)
0808 07:09:47.852858 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.852937 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260808 07:09:47.853114 23538 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:38713: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
I20260808 07:09:47.855134 23458 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } attempt: 3
Aug 08 07:09:47 dist-test-slave-77v9 krb5kdc[23373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for kudu/127.9.94.61@KRBTEST.COM
I20260808 07:09:47.863422 23542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.855562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56214 (local address 127.9.94.61:42235)
0808 07:09:47.855619 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:47.855621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:47.855633 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:09:47.855659 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:47.855660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:47.855671 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:47.855757 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:47.856346 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.857176 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.858044 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.858249 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.858321 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:47.860465 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:47.860467 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:47.860467 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:47.860474 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:47.862187 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:47.862564 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:47.862565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:47.862565 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:47.862621 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:47.862875 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:47.862876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:47.862876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:47.862989 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:47.863046 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:47.863263 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 07:09:47.863348 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:09:47.863533 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.855499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:42235 (local address 127.0.0.1:56214)
0808 07:09:47.855545 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.855558 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:47.855605 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:47.855795 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:47.855796 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:47.855990 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:47.856224 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:47.856228 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.857297 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.857298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:47.857846 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:47.857848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:47.858352 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:47.858353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:47.858422 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:47.858907 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:47.858912 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:47.860377 (+ 1465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:47.862299 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:47.862300 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:47.862301 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:47.862474 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:47.862724 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:47.862725 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:47.862725 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:47.862795 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:47.863063 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:47.863064 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:47.863110 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 07:09:47.863176 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 07:09:47.863266 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 07:09:47.864217 23458 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:09:47.864682 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.864529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:38713 (local address 127.0.0.1:58376)
0808 07:09:47.864626 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.864658 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 07:09:47.865157 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.865063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:38713 (local address 127.0.0.1:58390)
0808 07:09:47.865109 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.865135 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 07:09:47.865258 23458 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:38713: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.60.keytab.
Entry for principal kudu/127.9.94.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.60.keytab.
I20260808 07:09:47.867702 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.60:38713
--webserver_interface=127.9.94.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.60.keytab
--principal=kudu/127.9.94.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:42713,127.9.94.61:42235,127.9.94.60:38713
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:09:47.896423 23458 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } attempt: 1
I20260808 07:09:47.897346 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.897092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:38713 (local address 127.0.0.1:58406)
0808 07:09:47.897260 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.897312 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
I20260808 07:09:47.897787 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.897643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:38713 (local address 127.0.0.1:58422)
0808 07:09:47.897709 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.897754 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 07:09:47.898066 23458 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:38713: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
I20260808 07:09:47.902423 23538 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } attempt: 1
I20260808 07:09:47.902936 23540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.902789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:38713 (local address 127.0.0.1:58436)
0808 07:09:47.902859 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.902900 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 07:09:47.903342 23540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.903256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:38713 (local address 127.0.0.1:58438)
0808 07:09:47.903299 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.903324 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 07:09:47.903481 23538 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:38713: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
W20260808 07:09:47.962491 23545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:47.962774 23545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:47.962803 23545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:47.964115 23545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:47.964161 23545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:47.964177 23545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:47.964192 23545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:47.964206 23545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:47.965971 23545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:42713,127.9.94.61:42235,127.9.94.60:38713
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.60.keytab
--principal=kudu/127.9.94.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.60:38713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.94.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:47.966218 23545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:47.966425 23545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:09:47.971658 23538 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } attempt: 2
I20260808 07:09:47.972318 23540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.972072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:38713 (local address 127.0.0.1:58444)
0808 07:09:47.972187 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.972229 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 07:09:47.972687 23552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:47.972704 23551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:47.972970 23555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:47.972875 23545 server_base.cc:1034] running on GCE node
I20260808 07:09:47.973042 23540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.972659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:38713 (local address 127.0.0.1:58460)
0808 07:09:47.972955 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.972984 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256}
W20260808 07:09:47.973156 23538 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:38713: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
I20260808 07:09:47.973234 23458 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } attempt: 2
I20260808 07:09:47.973279 23545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:47.973692 23545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:47.973838 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.973493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:38713 (local address 127.0.0.1:58472)
0808 07:09:47.973718 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.973800 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197}
I20260808 07:09:47.974416 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:47.974150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:38713 (local address 127.0.0.1:58488)
0808 07:09:47.974293 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:47.974327 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 07:09:47.974628 23458 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:38713: Network error: Client connection negotiation failed: client connection to 127.9.94.60:38713: connect: Connection refused (error 111)
I20260808 07:09:47.974920 23545 hybrid_clock.cc:648] HybridClock initialized: now 1786172987974897 us; error 27 us; skew 500 ppm
Aug 08 07:09:47 dist-test-slave-77v9 krb5kdc[23373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:47.977721 23545 init.cc:377] Logged in from keytab as kudu/127.9.94.60@KRBTEST.COM (short username kudu)
I20260808 07:09:47.978381 23545 webserver.cc:460] Webserver started at http://127.9.94.60:44831/ using document root <none> and password file <none>
I20260808 07:09:47.978646 23545 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:47.978718 23545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:47.978856 23545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:47.979961 23545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/data/instance:
uuid: "0d80c7816cda4f1ba05c5ed3e4c25168"
format_stamp: "Formatted at 2026-08-08 07:09:47 on dist-test-slave-77v9"
server_key: "46d4860109b1183e37327867ffef2da2"
server_key_iv: "3ab93af332438bc93dee9aabfcc6471c"
server_key_version: "encryptionkey@0"
I20260808 07:09:47.980347 23545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/wal/instance:
uuid: "0d80c7816cda4f1ba05c5ed3e4c25168"
format_stamp: "Formatted at 2026-08-08 07:09:47 on dist-test-slave-77v9"
server_key: "46d4860109b1183e37327867ffef2da2"
server_key_iv: "3ab93af332438bc93dee9aabfcc6471c"
server_key_version: "encryptionkey@0"
I20260808 07:09:47.981832 23545 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:09:47.982664 23562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:47.982857 23545 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:47.983000 23545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/wal
uuid: "0d80c7816cda4f1ba05c5ed3e4c25168"
format_stamp: "Formatted at 2026-08-08 07:09:47 on dist-test-slave-77v9"
server_key: "46d4860109b1183e37327867ffef2da2"
server_key_iv: "3ab93af332438bc93dee9aabfcc6471c"
server_key_version: "encryptionkey@0"
I20260808 07:09:47.983083 23545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:48.002465 23545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:48.005573 23545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:48.005788 23545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:48.011075 23545 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.60:38713
I20260808 07:09:48.011588 23545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/data/info.pb
I20260808 07:09:48.011621 23617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.60:38713 every 8 connection(s)
I20260808 07:09:48.012431 23618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:48.014245 23618 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:09:48.014753 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 23545
I20260808 07:09:48.014962 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172813832116-9592-0/minicluster-data/master-2/wal/instance
I20260808 07:09:48.015220 9592 external_mini_cluster.cc:1428] Setting key 6cfeac2b239b32141d18524dd5c50788
Aug 08 07:09:48 dist-test-slave-77v9 krb5kdc[23373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.60@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
Aug 08 07:09:48 dist-test-slave-77v9 krb5kdc[23373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.60@KRBTEST.COM
I20260808 07:09:48.025877 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.015304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51704 (local address 127.9.94.62:42713)
0808 07:09:48.015429 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:48.015432 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:48.015812 (+ 380us) server_negotiation.cc:407] Connection header received
0808 07:09:48.017001 (+ 1189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:48.017003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:48.017017 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:48.017098 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:48.017732 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.018224 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.019390 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.019582 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.019673 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.022385 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:48.022387 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:48.022387 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:48.022395 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:48.024218 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.024728 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.024728 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.024729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.024786 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.025134 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.025135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.025135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.025301 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:48.025363 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:48.025704 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 07:09:48.025805 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 07:09:48.026293 23620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.015304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:42713 (local address 127.0.0.1:51704)
0808 07:09:48.015601 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:48.015672 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:48.016709 (+ 1037us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:48.017126 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:48.017129 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:48.017460 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:48.017627 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:48.017632 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.018312 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.018313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:48.019169 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:48.019172 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.019684 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.019686 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:48.019821 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.020425 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:48.020436 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:48.022277 (+ 1841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:48.024315 (+ 2038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:48.024321 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:48.024323 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:48.024642 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:48.024926 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:48.024926 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:48.024927 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:48.025064 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:48.025380 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:48.025384 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:48.025556 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 07:09:48.025640 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 07:09:48.025882 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":95,"thread_start_us":189,"threads_started":1}
I20260808 07:09:48.026455 23621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.015805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58498 (local address 127.9.94.60:38713)
0808 07:09:48.016029 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:48.016035 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:48.016144 (+ 109us) server_negotiation.cc:407] Connection header received
0808 07:09:48.016739 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:48.016756 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:48.016785 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:48.017139 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:48.017873 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.018763 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.019576 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.019909 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.019995 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.022969 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:48.022978 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:48.022978 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:48.022985 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:48.024892 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.025318 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.025320 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.025321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.025405 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.025711 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.025712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.025713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.025881 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:48.026049 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:48.026250 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 07:09:48.026344 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":104,"threads_started":1}
I20260808 07:09:48.026955 23618 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:09:48 dist-test-slave-77v9 krb5kdc[23373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.60@KRBTEST.COM for kudu/127.9.94.61@KRBTEST.COM
Aug 08 07:09:48 dist-test-slave-77v9 krb5kdc[23373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:48.036069 23542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.027319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56230 (local address 127.9.94.61:42235)
0808 07:09:48.027369 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:48.027372 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:48.027382 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:09:48.027410 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:48.027411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:48.027423 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:48.027485 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:48.027840 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.028665 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.029757 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.030036 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.030113 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.032493 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:48.032495 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:48.032495 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:48.032506 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:48.034649 (+ 2143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.035062 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.035063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.035064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.035138 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.035370 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.035371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.035372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.035510 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:48.035597 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:48.035780 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 07:09:48.035874 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:09:48.036082 23620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.027259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:42235 (local address 127.0.0.1:56230)
0808 07:09:48.027313 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:48.027324 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:48.027366 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:48.027503 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:48.027504 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:48.027664 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:48.027730 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:48.027732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.028791 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.028792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:48.029652 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:48.029655 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.030121 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.030122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:48.030184 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.030608 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:48.030612 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:48.032379 (+ 1767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:48.034746 (+ 2367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:48.034747 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:48.034747 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:48.034958 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:48.035215 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:48.035216 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:48.035217 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:48.035287 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:48.035589 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:48.035590 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:48.035652 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 07:09:48.035751 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 07:09:48.035880 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 07:09:48.037029 23618 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:09:48.037153 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.027372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51710 (local address 127.9.94.62:42713)
0808 07:09:48.027417 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:48.027419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:48.027450 (+ 31us) server_negotiation.cc:407] Connection header received
0808 07:09:48.027522 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:48.027523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:48.027531 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:48.027582 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:48.028176 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.028983 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.029930 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.030208 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.030257 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.033737 (+ 3480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:48.033739 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:48.033739 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:48.033747 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:48.035279 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.035683 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.035684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.035685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.035753 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.035990 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.035990 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.035991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.036113 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:48.036974 (+ 861us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:48.037013 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 07:09:48.037086 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Aug 08 07:09:48 dist-test-slave-77v9 krb5kdc[23373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.60@KRBTEST.COM for kudu/127.9.94.60@KRBTEST.COM
Aug 08 07:09:48 dist-test-slave-77v9 krb5kdc[23373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.61@KRBTEST.COM
I20260808 07:09:48.046277 23620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.037325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:38713 (local address 127.0.0.1:58510)
0808 07:09:48.037403 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:48.037413 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:48.037454 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:48.037605 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:48.037605 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:48.037796 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:48.037840 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:48.037842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.038467 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.038468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:48.038939 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:48.038940 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.039316 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.039316 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:48.039363 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.040215 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:48.040220 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:48.042189 (+ 1969us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:48.044558 (+ 2369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:48.044560 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:48.044561 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:48.044850 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:48.045313 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:48.045314 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:48.045314 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:48.045431 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:48.045790 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:48.045791 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:48.045847 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 07:09:48.045943 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 07:09:48.046068 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 07:09:48.046424 23621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.037403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58510 (local address 127.9.94.60:38713)
0808 07:09:48.037441 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:48.037443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:48.037451 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:09:48.037511 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:48.037512 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:48.037521 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:48.037568 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:48.037906 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.038383 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.039018 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.039229 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.039317 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.042358 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:48.042360 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:48.042360 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:48.042369 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:48.044440 (+ 2071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.044972 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.044975 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.044975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.045160 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.045553 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.045554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.045554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.045700 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:48.045768 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:48.046014 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 07:09:48.046126 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":21}
I20260808 07:09:48.048475 23542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.037907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56234 (local address 127.9.94.61:42235)
0808 07:09:48.037949 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:48.037951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:48.037960 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:09:48.037985 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:48.037986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:48.037995 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:48.038049 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:48.038591 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.039092 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.040203 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.040523 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.040630 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.044033 (+ 3403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:48.044035 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:48.044035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:48.044044 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:48.046174 (+ 2130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.047118 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.047119 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.047119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.047187 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.047410 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.047411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.047412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.047549 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:48.048238 (+ 689us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:48.048283 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 07:09:48.048383 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:09:48.048477 23618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168: Bootstrap starting.
I20260808 07:09:48.049738 23618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:48.050046 23618 log.cc:824] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:48.050601 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:48.051038 23618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168: No bootstrap required, opened a new log
I20260808 07:09:48.053532 23618 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } }
I20260808 07:09:48.053715 23618 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:48.053769 23618 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d80c7816cda4f1ba05c5ed3e4c25168, State: Initialized, Role: FOLLOWER
I20260808 07:09:48.053918 23618 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } }
I20260808 07:09:48.054221 23618 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 07:09:48.056093 23644 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:09:48.056152 23644 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:09:48.056468 23632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } } }
I20260808 07:09:48.056540 23632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:09:48.056442 23545 master_runner.cc:186] Error getting master registration for 127.9.94.62:42713: OK, instance_id { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" instance_seqno: 1786172987625545 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:09:48.059850 23545 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:09:48.061970 23621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.052532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58526 (local address 127.9.94.60:38713)
0808 07:09:48.052570 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:48.052572 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:48.053172 (+ 600us) server_negotiation.cc:407] Connection header received
0808 07:09:48.053279 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:48.053280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:48.053291 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:48.053321 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:48.054107 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.054806 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.056081 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.056381 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.056419 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.058371 (+ 1952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:48.058373 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:48.058373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:48.058381 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:48.060173 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.061011 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.061012 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.061013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.061079 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.061304 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.061305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.061305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.061481 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:48.061582 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:48.061771 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 07:09:48.061860 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:09:48.062589 23542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.052629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56246 (local address 127.9.94.61:42235)
0808 07:09:48.052671 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:48.052673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:48.053019 (+ 346us) server_negotiation.cc:407] Connection header received
0808 07:09:48.053085 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:48.053086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:48.053097 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:48.053150 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:48.054004 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.054798 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.055990 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.056272 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.056327 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.058372 (+ 2045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:48.058373 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:48.058373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:48.058380 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:48.060505 (+ 2125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.061108 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.061109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.061110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.061176 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.061389 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.061390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.061390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.061519 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:48.061616 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:48.062437 (+ 821us) server_negotiation.cc:299] Negotiation successful
0808 07:09:48.062527 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:09:48.064334 23538 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } attempt: 3
I20260808 07:09:48.069489 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.052331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51716 (local address 127.9.94.62:42713)
0808 07:09:48.052376 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:48.052378 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:48.052712 (+ 334us) server_negotiation.cc:407] Connection header received
0808 07:09:48.052843 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:48.052845 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:48.052857 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:48.052912 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:48.053746 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.054462 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.055585 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.055844 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.055894 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.066005 (+ 10111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:48.066007 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:48.066007 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:48.066016 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:48.067953 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.068436 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.068437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.068438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.068508 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.068745 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.068746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.068746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.068954 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:48.069074 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:48.069274 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 07:09:48.069374 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Aug 08 07:09:48 dist-test-slave-77v9 krb5kdc[23373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.61@KRBTEST.COM for kudu/127.9.94.60@KRBTEST.COM
I20260808 07:09:48.073329 23621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.065064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58538 (local address 127.9.94.60:38713)
0808 07:09:48.065144 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:48.065146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:48.065154 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:09:48.065172 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:48.065173 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:48.065181 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:48.065245 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:48.065643 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.066176 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.067550 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.067758 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.067846 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.070352 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:48.070353 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:48.070353 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:48.070362 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:48.071934 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.072398 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.072400 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.072400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.072497 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.072739 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.072739 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.072740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.072928 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:48.072998 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:48.073188 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 07:09:48.073258 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 07:09:48.073383 23540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.064774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:38713 (local address 127.0.0.1:58538)
0808 07:09:48.064874 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:48.064889 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:48.064951 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:48.065273 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:48.065274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:48.065453 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:48.065513 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:48.065515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.066672 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.066673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:48.067421 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:48.067424 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.067842 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.067843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:48.067912 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.068388 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:48.068394 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:48.070152 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:48.072033 (+ 1881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:48.072034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:48.072035 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:48.072279 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:48.072588 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:48.072589 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:48.072590 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:48.072664 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:48.073010 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:48.073011 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:48.073068 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 07:09:48.073158 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 07:09:48.073272 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 07:09:48.073787 23458 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } attempt: 3
I20260808 07:09:48.077732 23538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49: Bootstrap starting.
I20260808 07:09:48.078773 23538 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:48.079144 23538 log.cc:824] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49: Log is configured to *not* fsync() on all Append() calls
Aug 08 07:09:48 dist-test-slave-77v9 krb5kdc[23373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172987, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for kudu/127.9.94.60@KRBTEST.COM
I20260808 07:09:48.080137 23538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49: No bootstrap required, opened a new log
I20260808 07:09:48.082453 23538 raft_consensus.cc:348] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } }
I20260808 07:09:48.082602 23538 raft_consensus.cc:374] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:48.082638 23538 raft_consensus.cc:729] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 657d34f752ec464facf3b8a4ec090a49, State: Initialized, Role: FOLLOWER
I20260808 07:09:48.082919 23538 consensus_queue.cc:260] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } }
I20260808 07:09:48.083366 23538 sys_catalog.cc:564] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:48.083516 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.074441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:38713 (local address 127.0.0.1:58544)
0808 07:09:48.074496 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:48.074509 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:48.074559 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:48.075106 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:48.075108 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:48.075336 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:48.075406 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:48.075409 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.076775 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.076776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:48.077378 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:48.077380 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.077842 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.077843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:48.077923 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.078471 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:48.078476 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:48.079936 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:48.082156 (+ 2220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:48.082157 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:48.082158 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:48.082374 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:48.082686 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:48.082687 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:48.082688 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:48.082767 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:48.083129 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:48.083130 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:48.083201 (+ 71us) client_negotiation.cc:769] Sending connection context
0808 07:09:48.083266 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 07:09:48.083401 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 07:09:48.083894 23648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } } }
I20260808 07:09:48.084005 23646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.074572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58544 (local address 127.9.94.60:38713)
0808 07:09:48.074877 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:48.074879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:48.074891 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:09:48.074923 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:48.074924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:48.074947 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:48.075514 (+ 567us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:48.075582 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.076639 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.077486 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.077743 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.077842 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.080063 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:48.080065 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:48.080065 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:48.080073 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:48.082042 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.082483 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.082484 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.082485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.082581 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.082865 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.082866 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.082867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.083029 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:48.083668 (+ 639us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:48.083754 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 07:09:48.083855 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":179,"threads_started":1}
I20260808 07:09:48.084017 23648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:09:48.085882 23458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10: Bootstrap starting.
W20260808 07:09:48.086043 23659 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:09:48.086109 23659 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:09:48.086726 23458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:48.087075 23458 log.cc:824] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:48.088023 23458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10: No bootstrap required, opened a new log
I20260808 07:09:48.089993 23458 raft_consensus.cc:348] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } }
I20260808 07:09:48.090155 23458 raft_consensus.cc:374] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:48.090211 23458 raft_consensus.cc:729] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a21e34752a874c3b845c3b17e7e50d10, State: Initialized, Role: FOLLOWER
I20260808 07:09:48.090363 23458 consensus_queue.cc:260] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } }
I20260808 07:09:48.087634 23465 master_runner.cc:186] Error getting master registration for 127.9.94.62:42713: OK, instance_id { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" instance_seqno: 1786172987625545 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:09:48.090768 23458 sys_catalog.cc:564] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:48.090783 23465 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:09:48.090696 23662 sys_catalog.cc:455] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } } }
I20260808 07:09:48.090946 23662 sys_catalog.cc:458] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:09:48.093607 23674 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:09:48.093674 23674 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:09:48.097146 23386 master_runner.cc:263] No leader master found from master a21e34752a874c3b845c3b17e7e50d10
I20260808 07:09:48.097234 23386 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 07:09:48.123261 23409 tablet.cc:2369] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:09:48.225073 23632 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:48.225231 23632 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } }
I20260808 07:09:48.225507 23632 leader_election.cc:288] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a21e34752a874c3b845c3b17e7e50d10 (127.9.94.62:42713), 657d34f752ec464facf3b8a4ec090a49 (127.9.94.61:42235)
I20260808 07:09:48.225934 23511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "657d34f752ec464facf3b8a4ec090a49" is_pre_election: true
I20260808 07:09:48.226087 23511 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d80c7816cda4f1ba05c5ed3e4c25168 in term 0.
I20260808 07:09:48.226558 23563 leader_election.cc:302] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d80c7816cda4f1ba05c5ed3e4c25168, 657d34f752ec464facf3b8a4ec090a49; no voters:
I20260808 07:09:48.227062 23432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21e34752a874c3b845c3b17e7e50d10" is_pre_election: true
I20260808 07:09:48.227232 23432 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d80c7816cda4f1ba05c5ed3e4c25168 in term 0.
I20260808 07:09:48.227653 23632 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:09:48.227716 23632 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:09:48.227741 23632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:48.228775 23632 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } }
I20260808 07:09:48.229045 23632 leader_election.cc:288] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [CANDIDATE]: Term 1 election: Requested vote from peers a21e34752a874c3b845c3b17e7e50d10 (127.9.94.62:42713), 657d34f752ec464facf3b8a4ec090a49 (127.9.94.61:42235)
I20260808 07:09:48.229306 23432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21e34752a874c3b845c3b17e7e50d10"
I20260808 07:09:48.229384 23432 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:48.230428 23432 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d80c7816cda4f1ba05c5ed3e4c25168 in term 1.
I20260808 07:09:48.230712 23565 leader_election.cc:302] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d80c7816cda4f1ba05c5ed3e4c25168, a21e34752a874c3b845c3b17e7e50d10; no voters:
I20260808 07:09:48.231153 23511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "657d34f752ec464facf3b8a4ec090a49"
I20260808 07:09:48.231253 23511 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:48.232195 23511 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d80c7816cda4f1ba05c5ed3e4c25168 in term 1.
I20260808 07:09:48.232527 23632 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:48.232683 23632 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [term 1 LEADER]: Becoming Leader. State: Replica: 0d80c7816cda4f1ba05c5ed3e4c25168, State: Running, Role: LEADER
I20260808 07:09:48.232774 23632 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } }
I20260808 07:09:48.233280 23632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d80c7816cda4f1ba05c5ed3e4c25168. Latest consensus state: current_term: 1 leader_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } } }
I20260808 07:09:48.233349 23632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:48.235956 23678 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:48.236222 23678 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:48.238168 23511 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49 [term 1 FOLLOWER]: Refusing update from remote peer 0d80c7816cda4f1ba05c5ed3e4c25168: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:48.238642 23676 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:48.240464 23648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d80c7816cda4f1ba05c5ed3e4c25168. Latest consensus state: current_term: 1 leader_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } } }
I20260808 07:09:48.240568 23648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:09:48.241096 23432 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10 [term 1 FOLLOWER]: Refusing update from remote peer 0d80c7816cda4f1ba05c5ed3e4c25168: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:48.241456 23676 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:48.242871 23662 sys_catalog.cc:455] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d80c7816cda4f1ba05c5ed3e4c25168. Latest consensus state: current_term: 1 leader_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } } }
I20260808 07:09:48.243000 23662 sys_catalog.cc:458] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:09:48.244287 23676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } } }
I20260808 07:09:48.244377 23676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:48.244967 23648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } } }
I20260808 07:09:48.245057 23648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:09:48.245329 23679 mvcc.cc:205] Tried to move back new op lower bound from 7316164559820406784 to 7316164559802531840. Current Snapshot: MvccSnapshot[applied={T|T < 7316164559820406784}]
I20260808 07:09:48.245913 23680 mvcc.cc:205] Tried to move back new op lower bound from 7316164559820406784 to 7316164559802531840. Current Snapshot: MvccSnapshot[applied={T|T < 7316164559820406784}]
I20260808 07:09:48.246500 23678 catalog_manager.cc:1347] Generated new cluster ID: ebfff4a3cbc74096a9bf4842d10c6baa
I20260808 07:09:48.246546 23678 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:48.250092 23632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } } }
I20260808 07:09:48.250190 23632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:48.250705 23662 sys_catalog.cc:455] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21e34752a874c3b845c3b17e7e50d10" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 42713 } } peers { permanent_uuid: "657d34f752ec464facf3b8a4ec090a49" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 42235 } } peers { permanent_uuid: "0d80c7816cda4f1ba05c5ed3e4c25168" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 38713 } } }
I20260808 07:09:48.250793 23662 sys_catalog.cc:458] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:09:48.256929 23682 mvcc.cc:205] Tried to move back new op lower bound from 7316164559820406784 to 7316164559802531840. Current Snapshot: MvccSnapshot[applied={T|T < 7316164559820406784}]
I20260808 07:09:48.267045 23678 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:48.267719 23678 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:48.279050 23678 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0d80c7816cda4f1ba05c5ed3e4c25168: Generated new TSK 0
I20260808 07:09:48.279279 23678 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:49.086725 23659 catalog_manager.cc:1259] Loaded cluster ID: ebfff4a3cbc74096a9bf4842d10c6baa
I20260808 07:09:49.086814 23659 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49: loading cluster ID for follower catalog manager: success
I20260808 07:09:49.087738 23659 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49: acquiring CA information for follower catalog manager: success
I20260808 07:09:49.088106 23659 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 657d34f752ec464facf3b8a4ec090a49: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:09:49.094152 23674 catalog_manager.cc:1259] Loaded cluster ID: ebfff4a3cbc74096a9bf4842d10c6baa
I20260808 07:09:49.094254 23674 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10: loading cluster ID for follower catalog manager: success
I20260808 07:09:49.095139 23674 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10: acquiring CA information for follower catalog manager: success
I20260808 07:09:49.095470 23674 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a21e34752a874c3b845c3b17e7e50d10: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:09:49.343673 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 23386
I20260808 07:09:49.350883 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 23465
I20260808 07:09:49.357283 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 23545
2026-08-08T07:09:49Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3226 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:49 dist-test-slave-77v9 krb5kdc[23693](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:49 dist-test-slave-77v9 krb5kdc[23693](info): set up 2 sockets
Aug 08 07:09:49 dist-test-slave-77v9 krb5kdc[23693](info): commencing operation
krb5kdc: starting...
W20260808 07:09:50.494107 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:09:50 dist-test-slave-77v9 krb5kdc[23693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:09:50.636370 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:34455
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:36107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:34455
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:50.727191 23708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:50.727450 23708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:50.727480 23708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:50.728740 23708 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:50.728782 23708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:50.728797 23708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:50.728845 23708 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:50.728858 23708 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:50.730337 23708 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:36107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:34455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:34455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:50.730552 23708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:50.730739 23708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:50.736159 23716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:50.736178 23713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:50.736155 23714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:50.736553 23708 server_base.cc:1034] running on GCE node
I20260808 07:09:50.736874 23708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:50.737218 23708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:50.738430 23708 hybrid_clock.cc:648] HybridClock initialized: now 1786172990738399 us; error 53 us; skew 500 ppm
Aug 08 07:09:50 dist-test-slave-77v9 krb5kdc[23693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172990, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:50.741503 23708 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:09:50.742110 23708 webserver.cc:460] Webserver started at http://127.9.94.62:35649/ using document root <none> and password file <none>
I20260808 07:09:50.742475 23708 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:50.742559 23708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:50.742720 23708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:50.743968 23708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "1265644e5f7b4b26b048e197cadb2799"
format_stamp: "Formatted at 2026-08-08 07:09:50 on dist-test-slave-77v9"
server_key: "adc4718f6b94298966a50f5efdf7aa6d"
server_key_iv: "39ec44bdcd82cd61074f852934e249a8"
server_key_version: "encryptionkey@0"
I20260808 07:09:50.744397 23708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "1265644e5f7b4b26b048e197cadb2799"
format_stamp: "Formatted at 2026-08-08 07:09:50 on dist-test-slave-77v9"
server_key: "adc4718f6b94298966a50f5efdf7aa6d"
server_key_iv: "39ec44bdcd82cd61074f852934e249a8"
server_key_version: "encryptionkey@0"
I20260808 07:09:50.746142 23708 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260808 07:09:50.747053 23723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:50.747332 23708 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:50.747462 23708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "1265644e5f7b4b26b048e197cadb2799"
format_stamp: "Formatted at 2026-08-08 07:09:50 on dist-test-slave-77v9"
server_key: "adc4718f6b94298966a50f5efdf7aa6d"
server_key_iv: "39ec44bdcd82cd61074f852934e249a8"
server_key_version: "encryptionkey@0"
I20260808 07:09:50.747570 23708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:50.766072 23708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:50.769160 23708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:50.769382 23708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:50.774634 23708 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:34455
I20260808 07:09:50.774668 23777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:34455 every 8 connection(s)
I20260808 07:09:50.775142 23708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:50.776185 23778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:50.779913 23778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799: Bootstrap starting.
I20260808 07:09:50.780969 23778 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:50.781417 23778 log.cc:824] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:50.782959 23778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799: No bootstrap required, opened a new log
I20260808 07:09:50.783245 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 23708
I20260808 07:09:50.783380 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:09:50.783586 9592 external_mini_cluster.cc:1428] Setting key 87ee5ba541be03a34c8f2574d7dd8047
I20260808 07:09:50.785574 23778 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1265644e5f7b4b26b048e197cadb2799" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34455 } }
I20260808 07:09:50.785778 23778 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:50.785856 23778 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1265644e5f7b4b26b048e197cadb2799, State: Initialized, Role: FOLLOWER
I20260808 07:09:50.786089 23778 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1265644e5f7b4b26b048e197cadb2799" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34455 } }
I20260808 07:09:50.786222 23778 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:50.786267 23778 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:50.786342 23778 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:50.787540 23778 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1265644e5f7b4b26b048e197cadb2799" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34455 } }
I20260808 07:09:50.787650 23778 leader_election.cc:302] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1265644e5f7b4b26b048e197cadb2799; no voters:
I20260808 07:09:50.787904 23778 leader_election.cc:288] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:50.787958 23783 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:50.788164 23783 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [term 1 LEADER]: Becoming Leader. State: Replica: 1265644e5f7b4b26b048e197cadb2799, State: Running, Role: LEADER
I20260808 07:09:50.788247 23778 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:50.788295 23783 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1265644e5f7b4b26b048e197cadb2799" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34455 } }
I20260808 07:09:50.788671 23783 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1265644e5f7b4b26b048e197cadb2799. Latest consensus state: current_term: 1 leader_uuid: "1265644e5f7b4b26b048e197cadb2799" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1265644e5f7b4b26b048e197cadb2799" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34455 } } }
I20260808 07:09:50.788766 23783 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:50.788686 23785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1265644e5f7b4b26b048e197cadb2799" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1265644e5f7b4b26b048e197cadb2799" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34455 } } }
I20260808 07:09:50.789664 23785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:50.789920 23791 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:50.790534 23791 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:50.792419 23791 catalog_manager.cc:1347] Generated new cluster ID: 8d50139fdc7a406cba2660f65942ac77
I20260808 07:09:50.792479 23791 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:09:50 dist-test-slave-77v9 krb5kdc[23693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:50.797758 23782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:50.784169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43802 (local address 127.9.94.62:34455)
0808 07:09:50.784420 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:50.784436 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:50.784469 (+ 33us) server_negotiation.cc:407] Connection header received
0808 07:09:50.785609 (+ 1140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:50.785618 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:50.785694 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:50.785944 (+ 250us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:50.786777 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:50.787922 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:50.789104 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:50.789802 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:50.789941 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:50.793213 (+ 3272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:50.793217 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:50.793217 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:50.793231 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:50.795411 (+ 2180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:50.795811 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:50.795814 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:50.795815 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:50.795964 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:50.796156 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:50.796156 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:50.796157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:50.796470 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:50.796625 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:50.797341 (+ 716us) server_negotiation.cc:299] Negotiation successful
0808 07:09:50.797517 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":126,"threads_started":1}
I20260808 07:09:50.798626 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:50.801278 23791 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:50.801877 23791 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:50.807389 23791 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1265644e5f7b4b26b048e197cadb2799: Generated new TSK 0
I20260808 07:09:50.807626 23791 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:50.853040 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 23708
2026-08-08T07:09:50Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1494 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:50 dist-test-slave-77v9 krb5kdc[23806](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:50 dist-test-slave-77v9 krb5kdc[23806](info): set up 2 sockets
Aug 08 07:09:50 dist-test-slave-77v9 krb5kdc[23806](info): commencing operation
krb5kdc: starting...
W20260808 07:09:51.987412 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:09:52 dist-test-slave-77v9 krb5kdc[23806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:09:52.132965 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:35349
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:35349
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:52.222857 23821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:52.223074 23821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:52.223097 23821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:52.224258 23821 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:52.224303 23821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:52.224318 23821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:52.224331 23821 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:52.224344 23821 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:52.225973 23821 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:35349
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:35349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:52.226239 23821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:52.226513 23821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:52.231788 23827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:52.231953 23821 server_base.cc:1034] running on GCE node
W20260808 07:09:52.231864 23829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:52.231868 23826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:52.232393 23821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:52.232710 23821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:52.233889 23821 hybrid_clock.cc:648] HybridClock initialized: now 1786172992233881 us; error 41 us; skew 500 ppm
Aug 08 07:09:52 dist-test-slave-77v9 krb5kdc[23806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172992, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:52.236620 23821 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:09:52.237156 23821 webserver.cc:460] Webserver started at http://127.9.94.62:37799/ using document root <none> and password file <none>
I20260808 07:09:52.237418 23821 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:52.237491 23821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:52.237648 23821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:52.238744 23821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "b421506a7bca4afa82dc2c861a22c803"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "8b78f89402e59a7737d90754f787afe1"
server_key_iv: "ebdda23df85a1c3f5b8fcc0dd0ee5e51"
server_key_version: "encryptionkey@0"
I20260808 07:09:52.239149 23821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "b421506a7bca4afa82dc2c861a22c803"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "8b78f89402e59a7737d90754f787afe1"
server_key_iv: "ebdda23df85a1c3f5b8fcc0dd0ee5e51"
server_key_version: "encryptionkey@0"
I20260808 07:09:52.240600 23821 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:52.241621 23837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:52.241966 23821 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:52.242103 23821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "b421506a7bca4afa82dc2c861a22c803"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "8b78f89402e59a7737d90754f787afe1"
server_key_iv: "ebdda23df85a1c3f5b8fcc0dd0ee5e51"
server_key_version: "encryptionkey@0"
I20260808 07:09:52.242202 23821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:52.251178 23821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:52.253789 23821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:52.253985 23821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:52.258548 23821 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:35349
I20260808 07:09:52.258589 23891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:35349 every 8 connection(s)
I20260808 07:09:52.258997 23821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:52.259353 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 23821
I20260808 07:09:52.259512 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:09:52.259747 9592 external_mini_cluster.cc:1428] Setting key a152d2be28cfb05d1df32d7eddad85cb
I20260808 07:09:52.260277 23892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:52.263691 23892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: Bootstrap starting.
I20260808 07:09:52.264487 23892 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:52.264861 23892 log.cc:824] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:52.265669 23892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: No bootstrap required, opened a new log
Aug 08 07:09:52 dist-test-slave-77v9 krb5kdc[23806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:52.267840 23892 raft_consensus.cc:348] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } }
I20260808 07:09:52.268042 23892 raft_consensus.cc:374] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:52.268124 23892 raft_consensus.cc:729] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b421506a7bca4afa82dc2c861a22c803, State: Initialized, Role: FOLLOWER
I20260808 07:09:52.268328 23892 consensus_queue.cc:260] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } }
I20260808 07:09:52.268438 23892 raft_consensus.cc:388] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:52.268479 23892 raft_consensus.cc:482] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:52.268543 23892 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:52.269467 23892 raft_consensus.cc:504] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } }
I20260808 07:09:52.269589 23892 leader_election.cc:302] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b421506a7bca4afa82dc2c861a22c803; no voters:
I20260808 07:09:52.269771 23892 leader_election.cc:288] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:52.269824 23899 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:52.270095 23892 sys_catalog.cc:564] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:52.270102 23899 raft_consensus.cc:686] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 1 LEADER]: Becoming Leader. State: Replica: b421506a7bca4afa82dc2c861a22c803, State: Running, Role: LEADER
I20260808 07:09:52.270304 23899 consensus_queue.cc:237] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } }
I20260808 07:09:52.270704 23901 sys_catalog.cc:455] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b421506a7bca4afa82dc2c861a22c803. Latest consensus state: current_term: 1 leader_uuid: "b421506a7bca4afa82dc2c861a22c803" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } } }
I20260808 07:09:52.270790 23901 sys_catalog.cc:458] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:52.270689 23900 sys_catalog.cc:455] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b421506a7bca4afa82dc2c861a22c803" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } } }
I20260808 07:09:52.270902 23900 sys_catalog.cc:458] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:52.271099 23906 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:52.271653 23906 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:52.272629 23896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.260378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48022 (local address 127.9.94.62:35349)
0808 07:09:52.260580 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:52.260589 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:52.260623 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:09:52.261192 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:52.261200 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:52.261263 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:52.261416 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:52.262080 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.263458 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.264408 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.265183 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.265335 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.267760 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:52.267764 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:52.267764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:52.267777 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:52.270144 (+ 2367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:52.270643 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:52.270647 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:52.270647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:52.270779 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:52.271052 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:52.271053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:52.271053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:52.271447 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:52.272079 (+ 632us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:52.272228 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 07:09:52.272405 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":98,"threads_started":1}
I20260808 07:09:52.273830 23906 catalog_manager.cc:1347] Generated new cluster ID: cf6b790aeae9486dacd3b7d92ade57a0
I20260808 07:09:52.273895 23906 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:52.288117 23906 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:52.288760 23906 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:52.290906 23906 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: Generated new TSK 0
I20260808 07:09:52.291155 23906 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:09:52.324213 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:35349
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:52.414649 23920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:52.414867 23920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:52.414892 23920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:52.416038 23920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:52.416083 23920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:52.416109 23920 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:09:52.417616 23920 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:35349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:52.417876 23920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:52.418129 23920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:52.423942 23929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:52.423926 23920 server_base.cc:1034] running on GCE node
W20260808 07:09:52.423967 23927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:52.423878 23926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:52.424325 23920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:52.424597 23920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:52.425753 23920 hybrid_clock.cc:648] HybridClock initialized: now 1786172992425736 us; error 34 us; skew 500 ppm
Aug 08 07:09:52 dist-test-slave-77v9 krb5kdc[23806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172992, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:52.428949 23920 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:09:52.429518 23920 webserver.cc:460] Webserver started at http://127.9.94.1:43759/ using document root <none> and password file <none>
I20260808 07:09:52.429791 23920 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:52.429870 23920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:52.430043 23920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:52.431216 23920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "f478d0e895334c0bb4c0dc1550808d72"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "456c001a85a10934cc6aa5bf7e2f4707"
server_key_iv: "b730068326b257ecb6569b55e19ddb73"
server_key_version: "encryptionkey@0"
I20260808 07:09:52.431643 23920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "f478d0e895334c0bb4c0dc1550808d72"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "456c001a85a10934cc6aa5bf7e2f4707"
server_key_iv: "b730068326b257ecb6569b55e19ddb73"
server_key_version: "encryptionkey@0"
I20260808 07:09:52.433367 23920 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:52.434326 23936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:52.434532 23920 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:52.434648 23920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "f478d0e895334c0bb4c0dc1550808d72"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "456c001a85a10934cc6aa5bf7e2f4707"
server_key_iv: "b730068326b257ecb6569b55e19ddb73"
server_key_version: "encryptionkey@0"
I20260808 07:09:52.434744 23920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:52.456904 23920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:52.459620 23920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:52.459810 23920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:52.460116 23920 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:52.460459 23920 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:52.460517 23920 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:52.460561 23920 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:52.460597 23920 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:52.467077 23920 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:44047
I20260808 07:09:52.467121 24056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:44047 every 8 connection(s)
I20260808 07:09:52.467479 23920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:09:52.470952 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 23920
I20260808 07:09:52.471076 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:09:52.471297 9592 external_mini_cluster.cc:1428] Setting key 6f462a30af8b231ee6408f9554056d2d
Aug 08 07:09:52 dist-test-slave-77v9 krb5kdc[23806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172992, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:52.479066 23896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.468343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:36515 (local address 127.9.94.62:35349)
0808 07:09:52.468421 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:52.468424 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:52.468634 (+ 210us) server_negotiation.cc:407] Connection header received
0808 07:09:52.469220 (+ 586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:52.469222 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:52.469233 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:52.469301 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:52.470399 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.471141 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.472396 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.472684 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.472773 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.475439 (+ 2666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:52.475441 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:52.475441 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:52.475449 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:52.477409 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:52.477865 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:52.477866 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:52.477867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:52.477938 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:52.478256 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:52.478257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:52.478258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:52.478441 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:52.478525 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:52.478847 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 07:09:52.478950 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 07:09:52.479190 24059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.468313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:36515)
0808 07:09:52.468499 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:52.468537 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:52.469098 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:52.469355 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:52.469359 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:52.469960 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:52.470217 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:52.470223 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.471244 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.471245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:52.472310 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:52.472312 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.472782 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.472783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:52.472994 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.473570 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:52.473578 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:52.475332 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:52.477526 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:52.477535 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:52.477537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:52.477778 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:52.478055 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:52.478056 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:52.478057 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:52.478176 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:52.478547 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:52.478556 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:52.478695 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 07:09:52.478799 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 07:09:52.478964 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":118,"threads_started":1}
I20260808 07:09:52.480077 24057 heartbeater.cc:347] Connected to a master server at 127.9.94.62:35349
I20260808 07:09:52.480195 24057 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:52.480409 24057 heartbeater.cc:511] Master 127.9.94.62:35349 requested a full tablet report, sending...
I20260808 07:09:52.481101 23856 ts_manager.cc:194] Registered new tserver with Master: f478d0e895334c0bb4c0dc1550808d72 (127.9.94.1:44047)
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
I20260808 07:09:52.482124 23856 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:36515
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:09:52.505537 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:35349
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:52.599449 24062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:52.599691 24062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:52.599720 24062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:52.600997 24062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:52.601050 24062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:52.601080 24062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:09:52.602607 24062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:35349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:52.602875 24062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:52.603142 24062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:52.608840 24068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:52.608913 24070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:52.608870 24067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:52.609158 24062 server_base.cc:1034] running on GCE node
I20260808 07:09:52.609503 24062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:52.609782 24062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:52.611025 24062 hybrid_clock.cc:648] HybridClock initialized: now 1786172992611002 us; error 45 us; skew 500 ppm
Aug 08 07:09:52 dist-test-slave-77v9 krb5kdc[23806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172992, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:52.614483 24062 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:09:52.615016 24062 webserver.cc:460] Webserver started at http://127.9.94.2:34333/ using document root <none> and password file <none>
I20260808 07:09:52.615270 24062 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:52.615341 24062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:52.615494 24062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:52.616576 24062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "81f950713eeb4e729217c238e65a31f1"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "70d11fe83034f5f4865582c686e9a342"
server_key_iv: "729a28939632ec04c73f3e2846b60ebf"
server_key_version: "encryptionkey@0"
I20260808 07:09:52.616977 24062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "81f950713eeb4e729217c238e65a31f1"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "70d11fe83034f5f4865582c686e9a342"
server_key_iv: "729a28939632ec04c73f3e2846b60ebf"
server_key_version: "encryptionkey@0"
I20260808 07:09:52.618377 24062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:52.619196 24077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:52.619447 24062 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:52.619558 24062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "81f950713eeb4e729217c238e65a31f1"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "70d11fe83034f5f4865582c686e9a342"
server_key_iv: "729a28939632ec04c73f3e2846b60ebf"
server_key_version: "encryptionkey@0"
I20260808 07:09:52.619633 24062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:52.636205 24062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:52.638734 24062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:52.638916 24062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:52.639173 24062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:52.639513 24062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:52.639568 24062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:52.639611 24062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:52.639653 24062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:52.646044 24062 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:44889
I20260808 07:09:52.646093 24202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:44889 every 8 connection(s)
I20260808 07:09:52.646467 24062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:09:52.652637 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 24062
I20260808 07:09:52.652765 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:09:52.653013 9592 external_mini_cluster.cc:1428] Setting key 5afb35c21a1edfdeac7fa8ecacc38968
Aug 08 07:09:52 dist-test-slave-77v9 krb5kdc[23806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172992, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:52.656980 23896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.647278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:40729 (local address 127.9.94.62:35349)
0808 07:09:52.647333 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:52.647335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:52.647549 (+ 214us) server_negotiation.cc:407] Connection header received
0808 07:09:52.648114 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:52.648116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:52.648128 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:52.648183 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:52.649193 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.649713 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.650717 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.650930 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.651012 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.653600 (+ 2588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:52.653602 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:52.653602 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:52.653609 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:52.655324 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:52.655803 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:52.655804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:52.655805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:52.655881 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:52.656179 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:52.656180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:52.656180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:52.656312 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:52.656422 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:52.656743 (+ 321us) server_negotiation.cc:299] Negotiation successful
0808 07:09:52.656876 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:09:52.657202 24205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.647238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:40729)
0808 07:09:52.647392 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:52.647451 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:52.647997 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:52.648253 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:52.648257 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:52.648883 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:52.649086 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:52.649091 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.649816 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.649817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:52.650619 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:52.650621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.651018 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.651019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:52.651149 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.651721 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:52.651730 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:52.653498 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:52.655429 (+ 1931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:52.655436 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:52.655438 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:52.655718 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:52.655970 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:52.655970 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:52.655971 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:52.656094 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:52.656424 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:52.656432 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:52.656586 (+ 154us) client_negotiation.cc:769] Sending connection context
0808 07:09:52.656703 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 07:09:52.656922 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
I20260808 07:09:52.657970 24203 heartbeater.cc:347] Connected to a master server at 127.9.94.62:35349
I20260808 07:09:52.658095 24203 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:52.658285 24203 heartbeater.cc:511] Master 127.9.94.62:35349 requested a full tablet report, sending...
I20260808 07:09:52.658725 23856 ts_manager.cc:194] Registered new tserver with Master: 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889)
I20260808 07:09:52.659116 23856 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:40729
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:09:52.685112 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:35349
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:52.779138 24209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:52.779390 24209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:52.779419 24209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:52.780980 24209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:52.781028 24209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:52.781057 24209 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:09:52.782678 24209 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:35349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:52.782945 24209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:52.783221 24209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:52.788832 24215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:52.788813 24214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:52.788949 24217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:52.789192 24209 server_base.cc:1034] running on GCE node
I20260808 07:09:52.789494 24209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:52.789805 24209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:52.791056 24209 hybrid_clock.cc:648] HybridClock initialized: now 1786172992791021 us; error 54 us; skew 500 ppm
Aug 08 07:09:52 dist-test-slave-77v9 krb5kdc[23806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172992, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:52.800020 24209 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:09:52.800993 24209 webserver.cc:460] Webserver started at http://127.9.94.3:40579/ using document root <none> and password file <none>
I20260808 07:09:52.801337 24209 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:52.801395 24209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:52.801548 24209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:52.802690 24209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "27a6306ad03045a385bebb70ab297cd5"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "3001eda349c0be04a39651d2c49c1b36"
server_key_iv: "37fae5718f359e22f3fe3f0b54c9e9a7"
server_key_version: "encryptionkey@0"
I20260808 07:09:52.803081 24209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "27a6306ad03045a385bebb70ab297cd5"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "3001eda349c0be04a39651d2c49c1b36"
server_key_iv: "37fae5718f359e22f3fe3f0b54c9e9a7"
server_key_version: "encryptionkey@0"
I20260808 07:09:52.804550 24209 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:09:52.805613 24225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:52.805989 24209 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:52.806131 24209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "27a6306ad03045a385bebb70ab297cd5"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "3001eda349c0be04a39651d2c49c1b36"
server_key_iv: "37fae5718f359e22f3fe3f0b54c9e9a7"
server_key_version: "encryptionkey@0"
I20260808 07:09:52.806221 24209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:52.819895 24209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:52.823792 24209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:52.824004 24209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:52.824294 24209 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:52.824656 24209 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:52.824717 24209 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:52.824755 24209 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:52.824787 24209 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:52.831609 24209 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:45879
I20260808 07:09:52.831705 24342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:45879 every 8 connection(s)
I20260808 07:09:52.832069 24209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:09:52 dist-test-slave-77v9 krb5kdc[23806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172992, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:52.842301 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 24209
I20260808 07:09:52.842443 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:09:52.842681 9592 external_mini_cluster.cc:1428] Setting key 1a2bc78963ea942e89bc7bf8eeb6311c
I20260808 07:09:52.844540 23896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.833040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:50905 (local address 127.9.94.62:35349)
0808 07:09:52.833106 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:52.833109 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:52.833344 (+ 235us) server_negotiation.cc:407] Connection header received
0808 07:09:52.833861 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:52.833862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:52.833872 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:52.833980 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:52.835130 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.835689 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.836905 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.837192 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.837305 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.840160 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:52.840163 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:52.840163 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:52.840176 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:52.842537 (+ 2361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:52.843259 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:52.843260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:52.843261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:52.843362 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:52.843708 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:52.843709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:52.843709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:52.843889 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:52.844089 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:52.844381 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 07:09:52.844468 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:09:52.844753 24345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.833016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:50905)
0808 07:09:52.833202 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:52.833249 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:52.833766 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:52.834042 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:52.834045 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:52.834758 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:52.834992 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:52.834997 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.835811 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.835812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:52.836641 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:52.836643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.837344 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.837345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:52.837472 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.838211 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:52.838221 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:52.839974 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:52.842643 (+ 2669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:52.842654 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:52.842657 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:52.843107 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:52.843452 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:52.843453 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:52.843453 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:52.843629 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:52.844080 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:52.844086 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:52.844225 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 07:09:52.844328 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 07:09:52.844474 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":108,"threads_started":1}
I20260808 07:09:52.845301 24343 heartbeater.cc:347] Connected to a master server at 127.9.94.62:35349
I20260808 07:09:52.845455 24343 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:52.845675 24343 heartbeater.cc:511] Master 127.9.94.62:35349 requested a full tablet report, sending...
I20260808 07:09:52.846159 23856 ts_manager.cc:194] Registered new tserver with Master: 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879)
I20260808 07:09:52.846525 23856 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:50905
I20260808 07:09:52.855163 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:09:52.864629 23896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.857238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48024 (local address 127.9.94.62:35349)
0808 07:09:52.857442 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:52.857448 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:52.857607 (+ 159us) server_negotiation.cc:407] Connection header received
0808 07:09:52.858055 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:52.858056 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:52.858076 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:52.858226 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:52.858932 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.859422 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.860169 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.860366 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.860444 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.861825 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:52.861827 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:52.861827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:52.861835 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:52.863318 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:52.863723 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:52.863725 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:52.863725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:52.863789 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:52.864008 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:52.864009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:52.864009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:52.864180 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:52.864287 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:52.864434 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 07:09:52.864521 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260808 07:09:52.866639 23856 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48024:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:09:52.868517 23856 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:09:52.876753 24358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.871439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:44047 (local address 127.0.0.1:54476)
0808 07:09:52.871771 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:52.871784 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:52.871847 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:52.872202 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:52.872205 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:52.872208 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:52.872305 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:52.872308 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.873510 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.873511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:52.875067 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:52.875070 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.876366 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.876367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:52.876492 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.876511 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 07:09:52.876595 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 07:09:52.876654 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":66,"thread_start_us":99,"threads_started":1}
I20260808 07:09:52.876838 24357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.871458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54476 (local address 127.9.94.1:44047)
0808 07:09:52.871964 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:52.871972 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:52.871987 (+ 15us) server_negotiation.cc:407] Connection header received
0808 07:09:52.872045 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:52.872048 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:52.872066 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:52.872395 (+ 329us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:52.872476 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.873401 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.875314 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.876257 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.876344 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.876411 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:52.876634 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 07:09:52.876695 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":85,"threads_started":1}
I20260808 07:09:52.877188 24356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.871621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:45879 (local address 127.0.0.1:38512)
0808 07:09:52.871823 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:52.871833 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:52.871879 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:52.872342 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:52.872343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:52.872345 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:52.872408 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:52.872410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.873710 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.873711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:52.875067 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:52.875070 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.876916 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.876917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:52.876984 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.876989 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:09:52.877056 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 07:09:52.877106 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":4,"thread_start_us":115,"threads_started":1}
I20260808 07:09:52.877265 24360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.871923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38512 (local address 127.9.94.3:45879)
0808 07:09:52.872116 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:52.872120 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:52.872130 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:09:52.872169 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:52.872172 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:52.872189 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:52.872267 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:52.872506 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.873614 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.875223 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.876257 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.876348 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.876411 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:52.877099 (+ 688us) server_negotiation.cc:299] Negotiation successful
0808 07:09:52.877154 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":93,"threads_started":1}
I20260808 07:09:52.877517 24355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.871367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:44889 (local address 127.0.0.1:35884)
0808 07:09:52.871610 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:52.871657 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:52.871749 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:52.872251 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:52.872252 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:52.872255 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:52.872329 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:52.872331 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.875190 (+ 2859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.875190 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:52.876058 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:52.876069 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.877268 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.877269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:52.877342 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.877347 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:09:52.877407 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 07:09:52.877449 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":85,"threads_started":1}
I20260808 07:09:52.877560 24359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.871646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35884 (local address 127.9.94.2:44889)
0808 07:09:52.871999 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:52.872004 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:52.872014 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:09:52.872055 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:52.872057 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:52.872073 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:52.872148 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:52.872410 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.873599 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.876194 (+ 2595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.877088 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.877157 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.877226 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:52.877424 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 07:09:52.877468 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":88,"threads_started":1}
I20260808 07:09:52.877991 24274 tablet_service.cc:1467] Processing CreateTablet for tablet f2a44fc58acb48dca35a0ee521e944b3 (DEFAULT_TABLE table=test-table [id=5566739de4734a3fb6f2f6ddbe32083a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:52.878197 23985 tablet_service.cc:1467] Processing CreateTablet for tablet f2a44fc58acb48dca35a0ee521e944b3 (DEFAULT_TABLE table=test-table [id=5566739de4734a3fb6f2f6ddbe32083a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:52.878443 24274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2a44fc58acb48dca35a0ee521e944b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:52.878386 24129 tablet_service.cc:1467] Processing CreateTablet for tablet f2a44fc58acb48dca35a0ee521e944b3 (DEFAULT_TABLE table=test-table [id=5566739de4734a3fb6f2f6ddbe32083a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:52.878573 23985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2a44fc58acb48dca35a0ee521e944b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:52.878719 24129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2a44fc58acb48dca35a0ee521e944b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:52.881625 24361 tablet_bootstrap.cc:492] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5: Bootstrap starting.
I20260808 07:09:52.882252 24362 tablet_bootstrap.cc:492] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: Bootstrap starting.
I20260808 07:09:52.882524 24361 tablet_bootstrap.cc:654] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:52.882982 24362 tablet_bootstrap.cc:654] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:52.883263 24361 log.cc:824] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:52.883581 24362 log.cc:824] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:52.884006 24363 tablet_bootstrap.cc:492] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1: Bootstrap starting.
I20260808 07:09:52.884259 24361 tablet_bootstrap.cc:492] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5: No bootstrap required, opened a new log
I20260808 07:09:52.884332 24361 ts_tablet_manager.cc:1397] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:09:52.884646 24363 tablet_bootstrap.cc:654] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:52.885262 24362 tablet_bootstrap.cc:492] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: No bootstrap required, opened a new log
I20260808 07:09:52.885352 24362 ts_tablet_manager.cc:1397] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:09:52.885341 24363 log.cc:824] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:52.886234 24363 tablet_bootstrap.cc:492] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1: No bootstrap required, opened a new log
I20260808 07:09:52.886315 24363 ts_tablet_manager.cc:1397] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:09:52.886227 24361 raft_consensus.cc:348] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } }
I20260808 07:09:52.886507 24361 raft_consensus.cc:374] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:52.886559 24361 raft_consensus.cc:729] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27a6306ad03045a385bebb70ab297cd5, State: Initialized, Role: FOLLOWER
I20260808 07:09:52.886693 24361 consensus_queue.cc:260] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } }
I20260808 07:09:52.887006 24361 ts_tablet_manager.cc:1428] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:09:52.887164 24343 heartbeater.cc:503] Master 127.9.94.62:35349 was elected leader, sending a full tablet report...
I20260808 07:09:52.888118 24362 raft_consensus.cc:348] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } }
I20260808 07:09:52.888330 24362 raft_consensus.cc:374] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:52.888372 24362 raft_consensus.cc:729] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f478d0e895334c0bb4c0dc1550808d72, State: Initialized, Role: FOLLOWER
I20260808 07:09:52.888504 24362 consensus_queue.cc:260] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } }
I20260808 07:09:52.888523 24363 raft_consensus.cc:348] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } }
I20260808 07:09:52.888746 24363 raft_consensus.cc:374] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:52.888829 24363 raft_consensus.cc:729] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f950713eeb4e729217c238e65a31f1, State: Initialized, Role: FOLLOWER
I20260808 07:09:52.888888 24362 ts_tablet_manager.cc:1428] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:09:52.888918 24057 heartbeater.cc:503] Master 127.9.94.62:35349 was elected leader, sending a full tablet report...
I20260808 07:09:52.888968 24363 consensus_queue.cc:260] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } }
I20260808 07:09:52.889278 24363 ts_tablet_manager.cc:1428] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:09:52.889309 24203 heartbeater.cc:503] Master 127.9.94.62:35349 was elected leader, sending a full tablet report...
W20260808 07:09:52.897081 24204 tablet.cc:2369] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:09:52.968319 24058 tablet.cc:2369] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:09:53.082842 24344 tablet.cc:2369] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:09:53.130182 24367 raft_consensus.cc:482] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:53.130335 24367 raft_consensus.cc:504] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } }
I20260808 07:09:53.130769 24367 leader_election.cc:288] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889), f478d0e895334c0bb4c0dc1550808d72 (127.9.94.1:44047)
I20260808 07:09:53.134146 24370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.131053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:44047 (local address 127.9.94.3:34745)
0808 07:09:53.131253 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:53.131265 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:53.131343 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:53.131513 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:53.131514 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:53.131515 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:53.131617 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.131619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.132333 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.132334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.133260 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.133262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.133848 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.133850 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.133931 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.133943 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 07:09:53.133991 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 07:09:53.134025 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":116,"threads_started":1}
I20260808 07:09:53.134150 24357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.131151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:34745 (local address 127.9.94.1:44047)
0808 07:09:53.131203 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:53.131205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:53.131351 (+ 146us) server_negotiation.cc:407] Connection header received
0808 07:09:53.131409 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:53.131410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:53.131424 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:53.131491 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:53.131696 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.132202 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.133356 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.133758 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.133821 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.133831 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:53.134020 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 07:09:53.134073 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:09:53.134227 24359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.131145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:56761 (local address 127.9.94.2:44889)
0808 07:09:53.131253 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:53.131256 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:53.131268 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:09:53.131301 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:53.131302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:53.131316 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:53.131386 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:53.131586 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.132183 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.133368 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.133778 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.133879 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.133889 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:53.134102 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 07:09:53.134145 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 07:09:53.134281 24345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.131005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:44889 (local address 127.9.94.3:56761)
0808 07:09:53.131089 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:53.131104 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:53.131177 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:53.131405 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:53.131406 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:53.131408 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:53.131490 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.131492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.132277 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.132278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.133258 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.133261 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.133905 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.133906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.133996 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.134001 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:09:53.134077 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 07:09:53.134118 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":41}
I20260808 07:09:53.134573 24008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2a44fc58acb48dca35a0ee521e944b3" candidate_uuid: "27a6306ad03045a385bebb70ab297cd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f478d0e895334c0bb4c0dc1550808d72" is_pre_election: true
I20260808 07:09:53.134716 24155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2a44fc58acb48dca35a0ee521e944b3" candidate_uuid: "27a6306ad03045a385bebb70ab297cd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f950713eeb4e729217c238e65a31f1" is_pre_election: true
I20260808 07:09:53.134794 24008 raft_consensus.cc:2454] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27a6306ad03045a385bebb70ab297cd5 in term 0.
I20260808 07:09:53.134927 24155 raft_consensus.cc:2454] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27a6306ad03045a385bebb70ab297cd5 in term 0.
I20260808 07:09:53.135083 24227 leader_election.cc:302] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27a6306ad03045a385bebb70ab297cd5, f478d0e895334c0bb4c0dc1550808d72; no voters:
I20260808 07:09:53.135248 24367 raft_consensus.cc:2781] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:09:53.135349 24367 raft_consensus.cc:482] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:09:53.135383 24367 raft_consensus.cc:3037] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:53.136168 24367 raft_consensus.cc:504] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } }
I20260808 07:09:53.136356 24367 leader_election.cc:288] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [CANDIDATE]: Term 1 election: Requested vote from peers 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889), f478d0e895334c0bb4c0dc1550808d72 (127.9.94.1:44047)
I20260808 07:09:53.136564 24155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2a44fc58acb48dca35a0ee521e944b3" candidate_uuid: "27a6306ad03045a385bebb70ab297cd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f950713eeb4e729217c238e65a31f1"
I20260808 07:09:53.136564 24008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2a44fc58acb48dca35a0ee521e944b3" candidate_uuid: "27a6306ad03045a385bebb70ab297cd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f478d0e895334c0bb4c0dc1550808d72"
I20260808 07:09:53.136636 24008 raft_consensus.cc:3037] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:53.136667 24155 raft_consensus.cc:3037] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:53.137533 24155 raft_consensus.cc:2454] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27a6306ad03045a385bebb70ab297cd5 in term 1.
I20260808 07:09:53.137663 24008 raft_consensus.cc:2454] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27a6306ad03045a385bebb70ab297cd5 in term 1.
I20260808 07:09:53.137753 24229 leader_election.cc:302] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27a6306ad03045a385bebb70ab297cd5, 81f950713eeb4e729217c238e65a31f1; no voters:
I20260808 07:09:53.137866 24367 raft_consensus.cc:2781] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:53.138053 24367 raft_consensus.cc:686] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [term 1 LEADER]: Becoming Leader. State: Replica: 27a6306ad03045a385bebb70ab297cd5, State: Running, Role: LEADER
I20260808 07:09:53.138177 24367 consensus_queue.cc:237] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } }
I20260808 07:09:53.139230 23855 catalog_manager.cc:5495] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3). New cstate: current_term: 1 leader_uuid: "27a6306ad03045a385bebb70ab297cd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } health_report { overall_health: HEALTHY } } }
I20260808 07:09:53.165148 24360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.162404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38522 (local address 127.9.94.3:45879)
0808 07:09:53.162540 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:53.162542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:53.162552 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:09:53.162586 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:53.162587 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:53.162609 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:53.162684 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:09:53.162889 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.163380 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.164184 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.164416 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.164488 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.164671 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:09:53.164783 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:09:53.164998 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:53.165041 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 07:09:53.165064 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260808 07:09:53.167474 24155 raft_consensus.cc:1261] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1 [term 1 FOLLOWER]: Refusing update from remote peer 27a6306ad03045a385bebb70ab297cd5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:53.167474 24008 raft_consensus.cc:1261] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Refusing update from remote peer 27a6306ad03045a385bebb70ab297cd5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:53.167936 24371 consensus_queue.cc:1035] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:53.168112 24367 consensus_queue.cc:1035] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:53.170683 24374 mvcc.cc:205] Tried to move back new op lower bound from 7316164580009832448 to 7316164579894751232. Current Snapshot: MvccSnapshot[applied={T|T < 7316164580009832448}]
I20260808 07:09:53.170984 24375 mvcc.cc:205] Tried to move back new op lower bound from 7316164580009832448 to 7316164579894751232. Current Snapshot: MvccSnapshot[applied={T|T < 7316164580009832448}]
I20260808 07:09:53.172449 24376 mvcc.cc:205] Tried to move back new op lower bound from 7316164580009832448 to 7316164579894751232. Current Snapshot: MvccSnapshot[applied={T|T < 7316164580009832448 or (T in {7316164580009832448})}]
I20260808 07:09:53.173537 23856 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:53.173650 23856 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:53.174469 23856 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: Sending DeleteTablet for 3 replicas of tablet f2a44fc58acb48dca35a0ee521e944b3
I20260808 07:09:53.174855 23985 tablet_service.cc:1514] Processing DeleteTablet for tablet f2a44fc58acb48dca35a0ee521e944b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:53 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:54476
I20260808 07:09:53.174916 24129 tablet_service.cc:1514] Processing DeleteTablet for tablet f2a44fc58acb48dca35a0ee521e944b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:53 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:35884
I20260808 07:09:53.175127 24384 tablet_replica.cc:330] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: stopping tablet replica
I20260808 07:09:53.175242 24384 raft_consensus.cc:2229] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:53.175261 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 23920
I20260808 07:09:53.175359 24384 raft_consensus.cc:2258] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:53.175391 24274 tablet_service.cc:1514] Processing DeleteTablet for tablet f2a44fc58acb48dca35a0ee521e944b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:53 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:38512
I20260808 07:09:53.175686 24385 tablet_replica.cc:330] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1: stopping tablet replica
I20260808 07:09:53.175855 24385 raft_consensus.cc:2229] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:53.176060 24385 raft_consensus.cc:2258] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:53.178967 24385 ts_tablet_manager.cc:1905] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:53.181701 24385 ts_tablet_manager.cc:1918] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:53.181882 24385 log.cc:1196] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/f2a44fc58acb48dca35a0ee521e944b3
I20260808 07:09:53.182337 24385 ts_tablet_manager.cc:1939] T f2a44fc58acb48dca35a0ee521e944b3 P 81f950713eeb4e729217c238e65a31f1: Deleting consensus metadata
I20260808 07:09:53.183007 23841 catalog_manager.cc:4841] TS 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889): tablet f2a44fc58acb48dca35a0ee521e944b3 (table test-table [id=5566739de4734a3fb6f2f6ddbe32083a]) successfully deleted
I20260808 07:09:53.184417 24386 tablet_replica.cc:330] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5: stopping tablet replica
I20260808 07:09:53.184636 24386 raft_consensus.cc:2229] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:09:53.184872 24386 raft_consensus.cc:2258] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:53.185417 24386 ts_tablet_manager.cc:1905] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:53.187670 24386 ts_tablet_manager.cc:1918] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:53.187783 24386 log.cc:1196] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/f2a44fc58acb48dca35a0ee521e944b3
I20260808 07:09:53.188105 24386 ts_tablet_manager.cc:1939] T f2a44fc58acb48dca35a0ee521e944b3 P 27a6306ad03045a385bebb70ab297cd5: Deleting consensus metadata
I20260808 07:09:53.188570 23841 catalog_manager.cc:4841] TS 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879): tablet f2a44fc58acb48dca35a0ee521e944b3 (table test-table [id=5566739de4734a3fb6f2f6ddbe32083a]) successfully deleted
W20260808 07:09:53.190089 23839 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:44047 (error 108)
I20260808 07:09:53.190304 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 24062
I20260808 07:09:53.197372 24355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.197209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:44047 (local address 127.0.0.1:54486)
0808 07:09:53.197276 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:53.197324 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:44047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 07:09:53.197641 23839 catalog_manager.cc:4584] TS f478d0e895334c0bb4c0dc1550808d72 (127.9.94.1:44047): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f2a44fc58acb48dca35a0ee521e944b3: Network error: Client connection negotiation failed: client connection to 127.9.94.1:44047: connect: Connection refused (error 111)
I20260808 07:09:53.198801 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 24209
I20260808 07:09:53.204543 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 23821
I20260808 07:09:53.211476 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:35349
--webserver_interface=127.9.94.62
--webserver_port=37799
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:35349
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:53.305238 24388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:53.305490 24388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:53.305514 24388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:53.306689 24388 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:53.306734 24388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:53.306748 24388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:53.306761 24388 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:53.306774 24388 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:53.308252 24388 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:35349
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:35349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=37799
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:53.308495 24388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:53.308689 24388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:53.320104 24394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:53.320248 24395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:53.320384 24388 server_base.cc:1034] running on GCE node
W20260808 07:09:53.320104 24397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:53.320786 24388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:53.321247 24388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:53.322474 24388 hybrid_clock.cc:648] HybridClock initialized: now 1786172993322436 us; error 50 us; skew 500 ppm
Aug 08 07:09:53 dist-test-slave-77v9 krb5kdc[23806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172993, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:53.325820 24388 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:09:53.326372 24388 webserver.cc:460] Webserver started at http://127.9.94.62:37799/ using document root <none> and password file <none>
I20260808 07:09:53.326671 24388 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:53.326740 24388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:53.328328 24388 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:09:53.329360 24405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:53.329829 24388 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:09:53.329988 24388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "b421506a7bca4afa82dc2c861a22c803"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "8b78f89402e59a7737d90754f787afe1"
server_key_iv: "ebdda23df85a1c3f5b8fcc0dd0ee5e51"
server_key_version: "encryptionkey@0"
I20260808 07:09:53.330506 24388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:53.351974 24388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:53.354857 24388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:53.355088 24388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:53.360428 24388 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:35349
I20260808 07:09:53.360464 24460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:35349 every 8 connection(s)
I20260808 07:09:53.360908 24388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:53.362865 24461 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:09:53.363557 24461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: Bootstrap starting.
I20260808 07:09:53.368722 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 24388
I20260808 07:09:53.369165 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:44047
--local_ip_for_outbound_sockets=127.9.94.1
--tserver_master_addrs=127.9.94.62:35349
--webserver_port=43759
--webserver_interface=127.9.94.1
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:09:53.374342 24461 log.cc:824] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:53.376634 24461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:09:53.377015 24461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: Bootstrap complete.
I20260808 07:09:53.380352 24461 raft_consensus.cc:348] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } }
I20260808 07:09:53.380618 24461 raft_consensus.cc:729] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b421506a7bca4afa82dc2c861a22c803, State: Initialized, Role: FOLLOWER
I20260808 07:09:53.380842 24461 consensus_queue.cc:260] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } }
I20260808 07:09:53.380967 24461 raft_consensus.cc:388] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:53.381043 24461 raft_consensus.cc:482] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:53.381103 24461 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:09:53.382314 24461 raft_consensus.cc:504] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } }
I20260808 07:09:53.382414 24461 leader_election.cc:302] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b421506a7bca4afa82dc2c861a22c803; no voters:
I20260808 07:09:53.382656 24461 leader_election.cc:288] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 07:09:53.382701 24465 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:09:53.382839 24465 raft_consensus.cc:686] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 2 LEADER]: Becoming Leader. State: Replica: b421506a7bca4afa82dc2c861a22c803, State: Running, Role: LEADER
I20260808 07:09:53.382947 24465 consensus_queue.cc:237] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } }
I20260808 07:09:53.382982 24461 sys_catalog.cc:564] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:53.383462 24467 sys_catalog.cc:455] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b421506a7bca4afa82dc2c861a22c803. Latest consensus state: current_term: 2 leader_uuid: "b421506a7bca4afa82dc2c861a22c803" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } } }
I20260808 07:09:53.383553 24467 sys_catalog.cc:458] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:53.383822 24469 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:53.384409 24466 sys_catalog.cc:455] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b421506a7bca4afa82dc2c861a22c803" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } } }
I20260808 07:09:53.384569 24466 sys_catalog.cc:458] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:53.384868 24469 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:53.385016 24469 catalog_manager.cc:1259] Loaded cluster ID: cf6b790aeae9486dacd3b7d92ade57a0
I20260808 07:09:53.385070 24469 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:53.385798 24469 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 07:09:53.391120 24469 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 07:09:53.394642 24469 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:53.394950 24469 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: Loaded TSK: 0
I20260808 07:09:53.395206 24469 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:09:53.470763 24463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:53.471043 24463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:53.471086 24463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:53.472314 24463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:53.472389 24463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:53.472438 24463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:09:53.474179 24463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:44047
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=43759
--tserver_master_addrs=127.9.94.62:35349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:53.474483 24463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:53.474738 24463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:53.481381 24490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:53.481367 24493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:53.481369 24491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:53.481667 24463 server_base.cc:1034] running on GCE node
I20260808 07:09:53.481874 24463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:53.482235 24463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:53.483562 24463 hybrid_clock.cc:648] HybridClock initialized: now 1786172993483457 us; error 39 us; skew 500 ppm
Aug 08 07:09:53 dist-test-slave-77v9 krb5kdc[23806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172993, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:53.487308 24463 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:09:53.487874 24463 webserver.cc:460] Webserver started at http://127.9.94.1:43759/ using document root <none> and password file <none>
I20260808 07:09:53.488180 24463 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:53.488273 24463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:53.489877 24463 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:53.490658 24500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:53.490906 24463 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:53.491014 24463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "f478d0e895334c0bb4c0dc1550808d72"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "456c001a85a10934cc6aa5bf7e2f4707"
server_key_iv: "b730068326b257ecb6569b55e19ddb73"
server_key_version: "encryptionkey@0"
I20260808 07:09:53.491473 24463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:53.511003 24463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:53.513811 24463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:53.513988 24463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:53.514309 24463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:53.514891 24507 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 07:09:53.516487 24463 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 07:09:53.516541 24463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 07:09:53.516578 24463 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 07:09:53.517335 24463 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 07:09:53.517383 24463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 07:09:53.517426 24507 tablet_bootstrap.cc:492] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: Bootstrap starting.
I20260808 07:09:53.525090 24463 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:44047
I20260808 07:09:53.525324 24617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:44047 every 8 connection(s)
I20260808 07:09:53.525648 24463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:09:53.527395 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 24463
I20260808 07:09:53.527745 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:44889
--local_ip_for_outbound_sockets=127.9.94.2
--tserver_master_addrs=127.9.94.62:35349
--webserver_port=34333
--webserver_interface=127.9.94.2
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:09:53.529260 24507 log.cc:824] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:53.531447 24507 tablet_bootstrap.cc:492] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:09:53.531780 24507 tablet_bootstrap.cc:492] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: Bootstrap complete.
I20260808 07:09:53.532745 24507 ts_tablet_manager.cc:1397] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.009s
I20260808 07:09:53.533965 24507 raft_consensus.cc:348] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } }
I20260808 07:09:53.534271 24507 raft_consensus.cc:729] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f478d0e895334c0bb4c0dc1550808d72, State: Initialized, Role: FOLLOWER
I20260808 07:09:53.534433 24507 consensus_queue.cc:260] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } }
I20260808 07:09:53.534858 24507 ts_tablet_manager.cc:1428] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
Aug 08 07:09:53 dist-test-slave-77v9 krb5kdc[23806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172993, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:53.541738 24621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.526426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:60215)
0808 07:09:53.526896 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:53.526943 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:53.527692 (+ 749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:53.528718 (+ 1026us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:53.528723 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:53.529150 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:53.529500 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.529508 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.531375 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.531376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.532757 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.532761 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.533791 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.533792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.533957 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.534645 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:53.534655 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:53.536649 (+ 1994us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:53.539621 (+ 2972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:53.539630 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:53.539633 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:53.539968 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:53.540317 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:53.540318 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:53.540318 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:53.540464 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:53.541073 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:53.541079 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:53.541236 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 07:09:53.541343 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 07:09:53.541517 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":97,"threads_started":1}
I20260808 07:09:53.542289 24623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.526564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:60215 (local address 127.9.94.62:35349)
0808 07:09:53.526778 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:53.526788 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:53.527082 (+ 294us) server_negotiation.cc:407] Connection header received
0808 07:09:53.528376 (+ 1294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:53.528383 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:53.528443 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:53.528576 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:53.529653 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.531217 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.532916 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.533560 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.533653 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.536885 (+ 3232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:53.536892 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:53.536893 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:53.536910 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:53.539497 (+ 2587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:53.540073 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:53.540077 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:53.540077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:53.540218 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:53.540551 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:53.540552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:53.540553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:53.540977 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:53.541082 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:53.541438 (+ 356us) server_negotiation.cc:299] Negotiation successful
0808 07:09:53.541612 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":110,"threads_started":1}
I20260808 07:09:53.542971 24618 heartbeater.cc:347] Connected to a master server at 127.9.94.62:35349
I20260808 07:09:53.543097 24618 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:53.543336 24618 heartbeater.cc:511] Master 127.9.94.62:35349 requested a full tablet report, sending...
I20260808 07:09:53.544247 24422 ts_manager.cc:194] Registered new tserver with Master: f478d0e895334c0bb4c0dc1550808d72 (127.9.94.1:44047)
I20260808 07:09:53.545635 24422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:60215
I20260808 07:09:53.547148 24618 heartbeater.cc:503] Master 127.9.94.62:35349 was elected leader, sending a full tablet report...
I20260808 07:09:53.551753 24629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.545984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54494 (local address 127.9.94.1:44047)
0808 07:09:53.546202 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:53.546206 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:53.548022 (+ 1816us) server_negotiation.cc:407] Connection header received
0808 07:09:53.548134 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:53.548137 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:53.548153 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:53.548245 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:53.548465 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.549219 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.550834 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.551313 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.551383 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.551419 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:53.551649 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 07:09:53.551691 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":119,"threads_started":1}
I20260808 07:09:53.551754 24628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.545007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:44047 (local address 127.0.0.1:54494)
0808 07:09:53.547876 (+ 2869us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:53.547922 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:53.548023 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:53.548276 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:53.548280 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:53.548283 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:53.548369 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.548371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.549306 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.549307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.550674 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.550677 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.551404 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.551405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.551495 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.551510 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 07:09:53.551594 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 07:09:53.551654 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2829,"thread_start_us":98,"threads_started":1}
I20260808 07:09:53.552300 24550 tablet_service.cc:1514] Processing DeleteTablet for tablet f2a44fc58acb48dca35a0ee521e944b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:53 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:54494
I20260808 07:09:53.552907 24630 tablet_replica.cc:330] stopping tablet replica
I20260808 07:09:53.553048 24630 raft_consensus.cc:2229] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:53.553139 24630 raft_consensus.cc:2258] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:53.553596 24630 ts_tablet_manager.cc:1905] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:53.555864 24630 ts_tablet_manager.cc:1918] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:53.555972 24630 log.cc:1196] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal/wals/f2a44fc58acb48dca35a0ee521e944b3
I20260808 07:09:53.556293 24630 ts_tablet_manager.cc:1939] T f2a44fc58acb48dca35a0ee521e944b3 P f478d0e895334c0bb4c0dc1550808d72: Deleting consensus metadata
I20260808 07:09:53.556957 24407 catalog_manager.cc:4841] TS f478d0e895334c0bb4c0dc1550808d72 (127.9.94.1:44047): tablet f2a44fc58acb48dca35a0ee521e944b3 (table test-table [id=5566739de4734a3fb6f2f6ddbe32083a]) successfully deleted
W20260808 07:09:53.626325 24625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:53.626605 24625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:53.626648 24625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:53.627825 24625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:53.627900 24625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:53.627951 24625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:09:53.629519 24625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:44889
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=34333
--tserver_master_addrs=127.9.94.62:35349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:53.629823 24625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:53.630084 24625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:53.635743 24636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:53.635730 24638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:53.635706 24635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:53.636134 24625 server_base.cc:1034] running on GCE node
I20260808 07:09:53.636445 24625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:53.636691 24625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:53.637858 24625 hybrid_clock.cc:648] HybridClock initialized: now 1786172993637846 us; error 33 us; skew 500 ppm
Aug 08 07:09:53 dist-test-slave-77v9 krb5kdc[23806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172993, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:53.640527 24625 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:09:53.641136 24625 webserver.cc:460] Webserver started at http://127.9.94.2:34333/ using document root <none> and password file <none>
I20260808 07:09:53.641376 24625 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:53.641438 24625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:53.642886 24625 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:53.643610 24645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:53.643889 24625 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:53.643975 24625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "81f950713eeb4e729217c238e65a31f1"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "70d11fe83034f5f4865582c686e9a342"
server_key_iv: "729a28939632ec04c73f3e2846b60ebf"
server_key_version: "encryptionkey@0"
I20260808 07:09:53.644310 24625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:53.678088 24625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:53.680614 24625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:53.680747 24625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:53.681032 24625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:53.681399 24625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:53.681468 24625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:53.681504 24625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:53.681533 24625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:53.688956 24625 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:44889
I20260808 07:09:53.689019 24769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:44889 every 8 connection(s)
I20260808 07:09:53.689422 24625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:09:53.692596 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 24625
I20260808 07:09:53.692919 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:45879
--local_ip_for_outbound_sockets=127.9.94.3
--tserver_master_addrs=127.9.94.62:35349
--webserver_port=40579
--webserver_interface=127.9.94.3
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:09:53 dist-test-slave-77v9 krb5kdc[23806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172993, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:53.702064 24623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.690343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:42853 (local address 127.9.94.62:35349)
0808 07:09:53.690429 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:53.690432 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:53.690643 (+ 211us) server_negotiation.cc:407] Connection header received
0808 07:09:53.691189 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:53.691192 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:53.691211 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:53.691329 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:53.692449 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.693291 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.695176 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.695411 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.695483 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.698486 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:53.698488 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:53.698488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:53.698496 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:53.700266 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:53.700830 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:53.700832 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:53.700832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:53.700908 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:53.701208 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:53.701209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:53.701210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:53.701351 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:53.701436 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:53.701768 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 07:09:53.701881 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 07:09:53.702301 24772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.690293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:42853)
0808 07:09:53.690485 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:53.690529 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:53.691010 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:53.691464 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:53.691468 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:53.692066 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:53.692270 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.692274 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.693494 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.693496 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.694912 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.694918 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.695527 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.695528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.695754 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.696505 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:53.696516 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:53.698358 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:53.700408 (+ 2050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:53.700418 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:53.700421 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:53.700697 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:53.700990 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:53.700991 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:53.700991 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:53.701122 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:53.701441 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:53.701449 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:53.701616 (+ 167us) client_negotiation.cc:769] Sending connection context
0808 07:09:53.701730 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 07:09:53.702020 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":111,"threads_started":1}
I20260808 07:09:53.702873 24770 heartbeater.cc:347] Connected to a master server at 127.9.94.62:35349
I20260808 07:09:53.703007 24770 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:53.703248 24770 heartbeater.cc:511] Master 127.9.94.62:35349 requested a full tablet report, sending...
I20260808 07:09:53.703794 24422 ts_manager.cc:194] Registered new tserver with Master: 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889)
I20260808 07:09:53.704217 24422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:42853
W20260808 07:09:53.782781 24773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:53.783041 24773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:53.783070 24773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:53.784619 24773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:53.784698 24773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:53.784734 24773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:09:53.786561 24773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:45879
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=40579
--tserver_master_addrs=127.9.94.62:35349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:53.786876 24773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:53.787163 24773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:09:53.792848 24773 server_base.cc:1034] running on GCE node
W20260808 07:09:53.792797 24781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:53.792761 24778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:53.792745 24779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:53.793231 24773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:53.793496 24773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:53.794704 24773 hybrid_clock.cc:648] HybridClock initialized: now 1786172993794684 us; error 35 us; skew 500 ppm
Aug 08 07:09:53 dist-test-slave-77v9 krb5kdc[23806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172993, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:53.797585 24773 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:09:53.798122 24773 webserver.cc:460] Webserver started at http://127.9.94.3:40579/ using document root <none> and password file <none>
I20260808 07:09:53.798388 24773 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:53.798452 24773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:53.799880 24773 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:53.800606 24789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:53.800798 24773 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:53.800957 24773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "27a6306ad03045a385bebb70ab297cd5"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "3001eda349c0be04a39651d2c49c1b36"
server_key_iv: "37fae5718f359e22f3fe3f0b54c9e9a7"
server_key_version: "encryptionkey@0"
I20260808 07:09:53.801308 24773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:53.815659 24773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:53.818203 24773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:53.818390 24773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:53.818683 24773 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:53.819065 24773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:53.819103 24773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:53.819130 24773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:53.819181 24773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:53.825467 24773 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:45879
I20260808 07:09:53.825531 24910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:45879 every 8 connection(s)
I20260808 07:09:53.825937 24773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:09:53.830734 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 24773
Aug 08 07:09:53 dist-test-slave-77v9 krb5kdc[23806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172993, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:09:53.837365 24623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.826838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:43253 (local address 127.9.94.62:35349)
0808 07:09:53.826914 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:53.826916 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:53.827207 (+ 291us) server_negotiation.cc:407] Connection header received
0808 07:09:53.827814 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:53.827815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:53.827826 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:53.827899 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:53.829013 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.829511 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.830554 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.830811 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.830894 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.833477 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:53.833479 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:53.833479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:53.833488 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:53.835462 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:53.835951 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:53.835953 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:53.835953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:53.836033 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:53.836442 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:53.836443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:53.836443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:53.836562 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:53.836661 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:53.837153 (+ 492us) server_negotiation.cc:299] Negotiation successful
0808 07:09:53.837242 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 07:09:53.837723 24913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.826829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:43253)
0808 07:09:53.827032 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:53.827080 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:53.827589 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:53.828020 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:53.828023 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:53.828641 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:53.828920 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.828925 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.829595 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.829596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.830463 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.830466 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.830922 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.830923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.831098 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.831721 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:53.831730 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:53.833410 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:53.835558 (+ 2148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:53.835564 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:53.835566 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:53.835864 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:53.836178 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:53.836179 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:53.836180 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:53.836350 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:53.836652 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:53.836659 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:53.836943 (+ 284us) client_negotiation.cc:769] Sending connection context
0808 07:09:53.837118 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 07:09:53.837304 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":117,"threads_started":1}
I20260808 07:09:53.838433 24911 heartbeater.cc:347] Connected to a master server at 127.9.94.62:35349
I20260808 07:09:53.838543 24911 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:53.838738 24911 heartbeater.cc:511] Master 127.9.94.62:35349 requested a full tablet report, sending...
I20260808 07:09:53.839092 24422 ts_manager.cc:194] Registered new tserver with Master: 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879)
I20260808 07:09:53.839514 24422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:43253
I20260808 07:09:53.839706 24915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.831226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48038 (local address 127.9.94.62:35349)
0808 07:09:53.831688 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:53.831690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:53.831696 (+ 6us) server_negotiation.cc:407] Connection header received
0808 07:09:53.831715 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:53.831716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:53.831725 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:53.831895 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:53.832499 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.833109 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.834300 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.834609 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.834689 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.836206 (+ 1517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:53.836207 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:53.836208 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:53.836215 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:53.838188 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:53.838899 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:53.838900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:53.838900 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:53.838952 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:53.839175 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:53.839176 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:53.839177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:53.839297 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:53.839486 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:53.839523 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 07:09:53.839602 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":93,"threads_started":1}
I20260808 07:09:53.841308 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:09:53.844395 24915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.841759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48042 (local address 127.9.94.62:35349)
0808 07:09:53.841833 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:53.841834 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:53.841936 (+ 102us) server_negotiation.cc:407] Connection header received
0808 07:09:53.841989 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:53.841989 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:53.842020 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:53.842089 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:09:53.842202 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.842707 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.843524 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.843771 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.843845 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.844021 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:09:53.844118 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:09:53.844197 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:53.844247 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 07:09:53.844269 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 07:09:53.844846 24422 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:48042:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:09:53.846666 24422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:09:53.849164 24550 tablet_service.cc:1467] Processing CreateTablet for tablet a95b107ba605462992f207e91b72a3ac (DEFAULT_TABLE table=test-table [id=a77ccc1233e94fe8a9dd1887d9a4a348]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:53.849392 24550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a95b107ba605462992f207e91b72a3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:53.850801 24507 tablet_bootstrap.cc:492] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72: Bootstrap starting.
I20260808 07:09:53.851251 24507 tablet_bootstrap.cc:654] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:53.851889 24507 tablet_bootstrap.cc:492] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72: No bootstrap required, opened a new log
I20260808 07:09:53.851943 24507 ts_tablet_manager.cc:1397] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 07:09:53.852042 24507 raft_consensus.cc:348] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:09:53.852113 24507 raft_consensus.cc:374] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:53.852159 24507 raft_consensus.cc:729] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f478d0e895334c0bb4c0dc1550808d72, State: Initialized, Role: FOLLOWER
I20260808 07:09:53.852203 24507 consensus_queue.cc:260] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:09:53.852321 24507 ts_tablet_manager.cc:1428] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:53.853672 24918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.849006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:45879 (local address 127.0.0.1:38524)
0808 07:09:53.849301 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:53.849312 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:53.849367 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:53.849706 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:53.849707 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:53.849709 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:53.849759 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.849761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.851258 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.851259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.852335 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.852338 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.853417 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.853418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.853484 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.853489 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:09:53.853537 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 07:09:53.853586 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":88,"threads_started":1}
I20260808 07:09:53.853734 24921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.849310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38524 (local address 127.9.94.3:45879)
0808 07:09:53.849539 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:53.849543 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:53.849552 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:09:53.849589 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:53.849593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:53.849608 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:53.849689 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:53.849828 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.851179 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.852440 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.853243 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.853294 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.853356 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:53.853570 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 07:09:53.853642 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":105,"threads_started":1}
I20260808 07:09:53.853897 24628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.848893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:44889 (local address 127.0.0.1:35898)
0808 07:09:53.849135 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:53.849146 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:53.849212 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:53.849683 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:53.849684 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:53.849686 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:53.849743 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.849745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.851190 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.851191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.852230 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.852233 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.853641 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.853642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.853709 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.853713 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:53.853773 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 07:09:53.853822 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":3}
I20260808 07:09:53.854161 24920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.849086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35898 (local address 127.9.94.2:44889)
0808 07:09:53.849417 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:53.849422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:53.849432 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:09:53.849546 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:53.849548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:53.849568 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:53.849813 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:53.849890 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.851074 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.852605 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.853565 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.853630 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.853678 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:53.854033 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 07:09:53.854082 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":110,"threads_started":1}
I20260808 07:09:53.854646 24840 tablet_service.cc:1467] Processing CreateTablet for tablet a95b107ba605462992f207e91b72a3ac (DEFAULT_TABLE table=test-table [id=a77ccc1233e94fe8a9dd1887d9a4a348]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:53.854737 24699 tablet_service.cc:1467] Processing CreateTablet for tablet a95b107ba605462992f207e91b72a3ac (DEFAULT_TABLE table=test-table [id=a77ccc1233e94fe8a9dd1887d9a4a348]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:53.855003 24840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a95b107ba605462992f207e91b72a3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:53.855044 24699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a95b107ba605462992f207e91b72a3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:53.858168 24924 tablet_bootstrap.cc:492] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1: Bootstrap starting.
I20260808 07:09:53.858803 24924 tablet_bootstrap.cc:654] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:53.859230 24924 log.cc:824] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:53.859515 24923 tablet_bootstrap.cc:492] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5: Bootstrap starting.
I20260808 07:09:53.860060 24924 tablet_bootstrap.cc:492] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1: No bootstrap required, opened a new log
I20260808 07:09:53.860149 24923 tablet_bootstrap.cc:654] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:53.860144 24924 ts_tablet_manager.cc:1397] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:09:53.860734 24923 log.cc:824] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:53.861533 24923 tablet_bootstrap.cc:492] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5: No bootstrap required, opened a new log
I20260808 07:09:53.861608 24923 ts_tablet_manager.cc:1397] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:09:53.862330 24924 raft_consensus.cc:348] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:09:53.862526 24924 raft_consensus.cc:374] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:53.862564 24924 raft_consensus.cc:729] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f950713eeb4e729217c238e65a31f1, State: Initialized, Role: FOLLOWER
I20260808 07:09:53.862685 24924 consensus_queue.cc:260] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:09:53.863137 24924 ts_tablet_manager.cc:1428] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:09:53.863188 24770 heartbeater.cc:503] Master 127.9.94.62:35349 was elected leader, sending a full tablet report...
I20260808 07:09:53.863795 24923 raft_consensus.cc:348] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:09:53.864005 24923 raft_consensus.cc:374] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:53.864035 24923 raft_consensus.cc:729] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27a6306ad03045a385bebb70ab297cd5, State: Initialized, Role: FOLLOWER
I20260808 07:09:53.864151 24923 consensus_queue.cc:260] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:09:53.864480 24911 heartbeater.cc:503] Master 127.9.94.62:35349 was elected leader, sending a full tablet report...
I20260808 07:09:53.864482 24923 ts_tablet_manager.cc:1428] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260808 07:09:53.940120 24771 tablet.cc:2369] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:09:53.943126 24927 raft_consensus.cc:482] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:53.943284 24927 raft_consensus.cc:504] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:09:53.943764 24927 leader_election.cc:288] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879), f478d0e895334c0bb4c0dc1550808d72 (127.9.94.1:44047)
I20260808 07:09:53.947888 24772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.943963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:45879 (local address 127.9.94.2:49147)
0808 07:09:53.944010 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:53.944024 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:53.944072 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:53.944258 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:53.944259 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:53.944260 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:53.944338 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.944341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.945340 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.945341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.946672 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.946675 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.947552 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.947553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.947649 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.947653 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:53.947726 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 07:09:53.947789 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":62}
I20260808 07:09:53.947916 24629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.944052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:48631 (local address 127.9.94.1:44047)
0808 07:09:53.944099 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:53.944101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:53.944271 (+ 170us) server_negotiation.cc:407] Connection header received
0808 07:09:53.944322 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:53.944323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:53.944334 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:53.944401 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:53.944537 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.945253 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.946865 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.947426 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.947508 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.947520 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:53.947803 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 07:09:53.947852 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:09:53.947912 24921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.944052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:49147 (local address 127.9.94.3:45879)
0808 07:09:53.944105 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:53.944108 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:53.944116 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:09:53.944151 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:53.944152 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:53.944162 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:53.944216 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:53.944422 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.945219 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.946832 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.947426 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.947520 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.947530 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:53.947780 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 07:09:53.947837 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:09:53.947976 24929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.943964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:44047 (local address 127.9.94.2:48631)
0808 07:09:53.944189 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:53.944201 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:53.944261 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:53.944404 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:53.944405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:53.944407 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:53.944462 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.944463 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.945340 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.945341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.946677 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:53.946679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.947552 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.947553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:53.947649 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.947653 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:53.947726 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 07:09:53.947788 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":125,"thread_start_us":112,"threads_started":1}
I20260808 07:09:53.948313 24863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a95b107ba605462992f207e91b72a3ac" candidate_uuid: "81f950713eeb4e729217c238e65a31f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27a6306ad03045a385bebb70ab297cd5" is_pre_election: true
I20260808 07:09:53.948330 24570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a95b107ba605462992f207e91b72a3ac" candidate_uuid: "81f950713eeb4e729217c238e65a31f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f478d0e895334c0bb4c0dc1550808d72" is_pre_election: true
I20260808 07:09:53.948500 24863 raft_consensus.cc:2454] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f950713eeb4e729217c238e65a31f1 in term 0.
I20260808 07:09:53.948524 24570 raft_consensus.cc:2454] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81f950713eeb4e729217c238e65a31f1 in term 0.
I20260808 07:09:53.948736 24650 leader_election.cc:302] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27a6306ad03045a385bebb70ab297cd5, 81f950713eeb4e729217c238e65a31f1; no voters:
I20260808 07:09:53.948928 24927 raft_consensus.cc:2781] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:09:53.948989 24927 raft_consensus.cc:482] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:09:53.949012 24927 raft_consensus.cc:3037] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:53.949776 24927 raft_consensus.cc:504] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:09:53.949927 24927 leader_election.cc:288] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [CANDIDATE]: Term 1 election: Requested vote from peers 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879), f478d0e895334c0bb4c0dc1550808d72 (127.9.94.1:44047)
I20260808 07:09:53.950059 24863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a95b107ba605462992f207e91b72a3ac" candidate_uuid: "81f950713eeb4e729217c238e65a31f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27a6306ad03045a385bebb70ab297cd5"
I20260808 07:09:53.950140 24863 raft_consensus.cc:3037] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:53.950098 24570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a95b107ba605462992f207e91b72a3ac" candidate_uuid: "81f950713eeb4e729217c238e65a31f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f478d0e895334c0bb4c0dc1550808d72"
I20260808 07:09:53.950217 24570 raft_consensus.cc:3037] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:53.950861 24863 raft_consensus.cc:2454] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f950713eeb4e729217c238e65a31f1 in term 1.
I20260808 07:09:53.951085 24650 leader_election.cc:302] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27a6306ad03045a385bebb70ab297cd5, 81f950713eeb4e729217c238e65a31f1; no voters:
I20260808 07:09:53.951205 24927 raft_consensus.cc:2781] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:53.951378 24927 raft_consensus.cc:686] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [term 1 LEADER]: Becoming Leader. State: Replica: 81f950713eeb4e729217c238e65a31f1, State: Running, Role: LEADER
I20260808 07:09:53.951491 24927 consensus_queue.cc:237] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:09:53.951784 24570 raft_consensus.cc:2454] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81f950713eeb4e729217c238e65a31f1 in term 1.
I20260808 07:09:53.952394 24422 catalog_manager.cc:5495] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81f950713eeb4e729217c238e65a31f1 (127.9.94.2). New cstate: current_term: 1 leader_uuid: "81f950713eeb4e729217c238e65a31f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } health_report { overall_health: UNKNOWN } } }
I20260808 07:09:53.972172 24920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.969602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35908 (local address 127.9.94.2:44889)
0808 07:09:53.969675 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:53.969677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:53.969691 (+ 14us) server_negotiation.cc:407] Connection header received
0808 07:09:53.969731 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:53.969731 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:53.969753 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:53.969817 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:09:53.969937 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.970417 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.971253 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:53.971493 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:53.971564 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:53.971773 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:09:53.971875 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:09:53.971952 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:53.972008 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 07:09:53.972028 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 07:09:53.974325 24863 raft_consensus.cc:1261] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5 [term 1 FOLLOWER]: Refusing update from remote peer 81f950713eeb4e729217c238e65a31f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:53.974325 24570 raft_consensus.cc:1261] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Refusing update from remote peer 81f950713eeb4e729217c238e65a31f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:53.974697 24930 consensus_queue.cc:1035] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:53.974848 24927 consensus_queue.cc:1035] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:53.977267 24933 mvcc.cc:205] Tried to move back new op lower bound from 7316164583315779584 to 7316164583225954304. Current Snapshot: MvccSnapshot[applied={T|T < 7316164583315779584}]
I20260808 07:09:53.977607 24936 mvcc.cc:205] Tried to move back new op lower bound from 7316164583315779584 to 7316164583225954304. Current Snapshot: MvccSnapshot[applied={T|T < 7316164583315779584}]
I20260808 07:09:53.979825 24421 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:48042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:53.979938 24421 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:48042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:53.980712 24421 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: Sending DeleteTablet for 3 replicas of tablet a95b107ba605462992f207e91b72a3ac
I20260808 07:09:53.981091 24550 tablet_service.cc:1514] Processing DeleteTablet for tablet a95b107ba605462992f207e91b72a3ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:53 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:54494
I20260808 07:09:53.981134 24840 tablet_service.cc:1514] Processing DeleteTablet for tablet a95b107ba605462992f207e91b72a3ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:53 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:38524
I20260808 07:09:53.981210 24630 tablet_replica.cc:330] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72: stopping tablet replica
I20260808 07:09:53.981267 24630 raft_consensus.cc:2229] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:53.981335 24630 raft_consensus.cc:2258] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:53.981403 24944 tablet_replica.cc:330] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5: stopping tablet replica
I20260808 07:09:53.981438 24699 tablet_service.cc:1514] Processing DeleteTablet for tablet a95b107ba605462992f207e91b72a3ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:53 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:35898
I20260808 07:09:53.981499 24944 raft_consensus.cc:2229] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:53.981604 24944 raft_consensus.cc:2258] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:53.981679 24945 tablet_replica.cc:330] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1: stopping tablet replica
I20260808 07:09:53.981771 24945 raft_consensus.cc:2229] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:09:53.981841 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 24463
I20260808 07:09:53.981889 24945 raft_consensus.cc:2258] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:53.983117 24945 ts_tablet_manager.cc:1905] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:53.985669 24945 ts_tablet_manager.cc:1918] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:53.985754 24945 log.cc:1196] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/a95b107ba605462992f207e91b72a3ac
I20260808 07:09:53.986128 24945 ts_tablet_manager.cc:1939] T a95b107ba605462992f207e91b72a3ac P 81f950713eeb4e729217c238e65a31f1: Deleting consensus metadata
I20260808 07:09:53.986747 24409 catalog_manager.cc:4841] TS 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889): tablet a95b107ba605462992f207e91b72a3ac (table test-table [id=a77ccc1233e94fe8a9dd1887d9a4a348]) successfully deleted
I20260808 07:09:53.990510 24944 ts_tablet_manager.cc:1905] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:53.992236 24944 ts_tablet_manager.cc:1918] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:53.992355 24944 log.cc:1196] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/a95b107ba605462992f207e91b72a3ac
I20260808 07:09:53.992633 24944 ts_tablet_manager.cc:1939] T a95b107ba605462992f207e91b72a3ac P 27a6306ad03045a385bebb70ab297cd5: Deleting consensus metadata
I20260808 07:09:53.993134 24409 catalog_manager.cc:4841] TS 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879): tablet a95b107ba605462992f207e91b72a3ac (table test-table [id=a77ccc1233e94fe8a9dd1887d9a4a348]) successfully deleted
W20260808 07:09:53.995277 24407 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:44047 (error 108)
I20260808 07:09:53.995724 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 24625
I20260808 07:09:53.996029 24628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:53.995895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:44047 (local address 127.0.0.1:54506)
0808 07:09:53.995948 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:53.995987 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:44047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 07:09:53.996135 24407 catalog_manager.cc:4584] TS f478d0e895334c0bb4c0dc1550808d72 (127.9.94.1:44047): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a95b107ba605462992f207e91b72a3ac: Network error: Client connection negotiation failed: client connection to 127.9.94.1:44047: connect: Connection refused (error 111)
I20260808 07:09:54.002130 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 24773
I20260808 07:09:54.008708 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 24388
I20260808 07:09:54.015702 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:35349
--webserver_interface=127.9.94.62
--webserver_port=37799
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:35349
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:54.104615 24947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:54.104944 24947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:54.104976 24947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:54.106174 24947 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:54.106215 24947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:54.106230 24947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:54.106243 24947 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:54.106256 24947 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:54.107781 24947 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:35349
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:35349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=37799
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24947
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:54.107997 24947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:54.108186 24947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:54.113804 24956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:54.113804 24954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:54.113804 24947 server_base.cc:1034] running on GCE node
W20260808 07:09:54.113804 24953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:54.114436 24947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:54.114786 24947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:54.116012 24947 hybrid_clock.cc:648] HybridClock initialized: now 1786172994115997 us; error 29 us; skew 500 ppm
Aug 08 07:09:54 dist-test-slave-77v9 krb5kdc[23806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172994, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:54.119143 24947 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:09:54.119625 24947 webserver.cc:460] Webserver started at http://127.9.94.62:37799/ using document root <none> and password file <none>
I20260808 07:09:54.119886 24947 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:54.119961 24947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:54.121481 24947 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:09:54.122437 24964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:54.122639 24947 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:54.122740 24947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "b421506a7bca4afa82dc2c861a22c803"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "8b78f89402e59a7737d90754f787afe1"
server_key_iv: "ebdda23df85a1c3f5b8fcc0dd0ee5e51"
server_key_version: "encryptionkey@0"
I20260808 07:09:54.123380 24947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:54.134699 24947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:54.137017 24947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:54.137188 24947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:54.142113 24947 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:35349
I20260808 07:09:54.142284 25019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:35349 every 8 connection(s)
I20260808 07:09:54.142634 24947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:54.144395 25020 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:09:54.145162 25020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: Bootstrap starting.
I20260808 07:09:54.152693 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 24947
I20260808 07:09:54.153136 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:44047
--local_ip_for_outbound_sockets=127.9.94.1
--tserver_master_addrs=127.9.94.62:35349
--webserver_port=43759
--webserver_interface=127.9.94.1
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:09:54.155742 25020 log.cc:824] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:54.159691 25020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:09:54.160133 25020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803: Bootstrap complete.
I20260808 07:09:54.164520 25020 raft_consensus.cc:348] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } }
I20260808 07:09:54.164978 25020 raft_consensus.cc:729] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b421506a7bca4afa82dc2c861a22c803, State: Initialized, Role: FOLLOWER
I20260808 07:09:54.165192 25020 consensus_queue.cc:260] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } }
I20260808 07:09:54.165294 25020 raft_consensus.cc:388] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:54.165361 25020 raft_consensus.cc:482] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:54.165431 25020 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:09:54.167456 25020 raft_consensus.cc:504] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } }
I20260808 07:09:54.167610 25020 leader_election.cc:302] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b421506a7bca4afa82dc2c861a22c803; no voters:
I20260808 07:09:54.167837 25020 leader_election.cc:288] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 07:09:54.167976 25024 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 07:09:54.168159 25024 raft_consensus.cc:686] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [term 3 LEADER]: Becoming Leader. State: Replica: b421506a7bca4afa82dc2c861a22c803, State: Running, Role: LEADER
I20260808 07:09:54.168270 25024 consensus_queue.cc:237] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } }
I20260808 07:09:54.168566 25024 sys_catalog.cc:455] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b421506a7bca4afa82dc2c861a22c803" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } } }
I20260808 07:09:54.168596 25020 sys_catalog.cc:564] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:54.168630 25024 sys_catalog.cc:458] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:54.168735 25025 sys_catalog.cc:455] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b421506a7bca4afa82dc2c861a22c803. Latest consensus state: current_term: 3 leader_uuid: "b421506a7bca4afa82dc2c861a22c803" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b421506a7bca4afa82dc2c861a22c803" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 35349 } } }
I20260808 07:09:54.168839 25025 sys_catalog.cc:458] T 00000000000000000000000000000000 P b421506a7bca4afa82dc2c861a22c803 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:54.169348 25028 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:54.170176 25028 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:54.170296 25028 catalog_manager.cc:1259] Loaded cluster ID: cf6b790aeae9486dacd3b7d92ade57a0
I20260808 07:09:54.170329 25028 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 07:09:54.170636 25028 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f5df5cbc9ad google::LogMessage::Fail() at ??:0
@ 0x7f5df5cbf88a google::LogMessage::SendToLog() at ??:0
@ 0x7f5df5cbc4de google::LogMessage::Flush() at ??:0
@ 0x7f5df5cbda19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f5dfdbdd0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f5dfdbe68b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f5df7b8a0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f5df7b7f954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f5df89e36db start_thread at ??:0
@ 0x7f5df47ba61f clone at ??:0
W20260808 07:09:54.258184 25022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:54.258488 25022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:54.258534 25022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:54.259852 25022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:54.259927 25022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:54.259974 25022 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:09:54.261689 25022 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:44047
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=43759
--tserver_master_addrs=127.9.94.62:35349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:54.261987 25022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:54.262243 25022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:54.267659 25057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:54.267645 25060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:54.267628 25058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:54.269155 25022 server_base.cc:1034] running on GCE node
I20260808 07:09:54.269436 25022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:54.269735 25022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:54.270992 25022 hybrid_clock.cc:648] HybridClock initialized: now 1786172994270963 us; error 50 us; skew 500 ppm
Aug 08 07:09:54 dist-test-slave-77v9 krb5kdc[23806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172994, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:54.273917 25022 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:09:54.274483 25022 webserver.cc:460] Webserver started at http://127.9.94.1:43759/ using document root <none> and password file <none>
I20260808 07:09:54.274755 25022 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:54.274839 25022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:54.276500 25022 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:09:54.277467 25067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:54.277657 25022 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:09:54.277760 25022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "f478d0e895334c0bb4c0dc1550808d72"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "456c001a85a10934cc6aa5bf7e2f4707"
server_key_iv: "b730068326b257ecb6569b55e19ddb73"
server_key_version: "encryptionkey@0"
I20260808 07:09:54.278187 25022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:54.292444 25022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:54.295562 25022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:54.295966 25022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:54.296293 25022 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:54.296967 25075 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 07:09:54.298573 25022 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 07:09:54.298635 25022 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 07:09:54.298663 25022 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 07:09:54.299374 25022 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 07:09:54.299423 25022 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 07:09:54.299475 25075 tablet_bootstrap.cc:492] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72: Bootstrap starting.
I20260808 07:09:54.308009 25022 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:44047
I20260808 07:09:54.308207 25187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:44047 every 8 connection(s)
I20260808 07:09:54.308612 25022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:09:54.311175 25075 log.cc:824] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:54.311272 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 25022
I20260808 07:09:54.311597 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:44889
--local_ip_for_outbound_sockets=127.9.94.2
--tserver_master_addrs=127.9.94.62:35349
--webserver_port=34333
--webserver_interface=127.9.94.2
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:09:54.313418 25075 tablet_bootstrap.cc:492] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:09:54.313731 25075 tablet_bootstrap.cc:492] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72: Bootstrap complete.
I20260808 07:09:54.314970 25075 ts_tablet_manager.cc:1397] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.009s
I20260808 07:09:54.316859 25075 raft_consensus.cc:348] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:09:54.317301 25075 raft_consensus.cc:729] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f478d0e895334c0bb4c0dc1550808d72, State: Initialized, Role: FOLLOWER
I20260808 07:09:54.317505 25075 consensus_queue.cc:260] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:09:54.317852 25075 ts_tablet_manager.cc:1428] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s
W20260808 07:09:54.391237 25190 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:09:54.309806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:50339)
0808 07:09:54.310120 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:54.310167 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:54.310868 (+ 701us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:54.391059 (+ 80191us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":110,"threads_started":1}
W20260808 07:09:54.391597 25188 heartbeater.cc:644] Failed to heartbeat to 127.9.94.62:35349 (0 consecutive failures): Network error: Failed to ping master at 127.9.94.62:35349: Client connection negotiation failed: client connection to 127.9.94.62:35349: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 07:09:54.391995 25190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:54.391863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:40901)
0808 07:09:54.391926 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:54.391974 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 07:09:54.392619 25190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:54.392310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:34965)
0808 07:09:54.392434 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:54.392574 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260808 07:09:54.392897 25188 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:09:54.405655 25192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:54.405895 25192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:54.405922 25192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:54.407078 25192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:54.407121 25192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:54.407150 25192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:09:54.408653 25192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:44889
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=34333
--tserver_master_addrs=127.9.94.62:35349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:54.408964 25192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:54.409180 25192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:54.415012 25201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:54.415050 25203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:54.415143 25192 server_base.cc:1034] running on GCE node
W20260808 07:09:54.415012 25200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:54.415580 25192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:54.415825 25192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:54.416983 25192 hybrid_clock.cc:648] HybridClock initialized: now 1786172994416951 us; error 53 us; skew 500 ppm
Aug 08 07:09:54 dist-test-slave-77v9 krb5kdc[23806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172994, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:54.420079 25192 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:09:54.420591 25192 webserver.cc:460] Webserver started at http://127.9.94.2:34333/ using document root <none> and password file <none>
I20260808 07:09:54.420898 25192 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:54.421063 25192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:54.422617 25192 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:54.423391 25210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:54.423784 25192 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:54.423905 25192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "81f950713eeb4e729217c238e65a31f1"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "70d11fe83034f5f4865582c686e9a342"
server_key_iv: "729a28939632ec04c73f3e2846b60ebf"
server_key_version: "encryptionkey@0"
I20260808 07:09:54.424638 25192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:54.436125 25192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:54.439177 25192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:54.439350 25192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:54.439693 25192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:54.440188 25192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:54.440243 25192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:54.440274 25192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:54.440289 25192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:54.449128 25192 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:44889
I20260808 07:09:54.449277 25330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:44889 every 8 connection(s)
I20260808 07:09:54.450045 25192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:09:54.451443 25333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:54.450876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:58349)
0808 07:09:54.451135 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:54.451225 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":101,"threads_started":1}
W20260808 07:09:54.451936 25331 heartbeater.cc:644] Failed to heartbeat to 127.9.94.62:35349 (0 consecutive failures): Network error: Failed to ping master at 127.9.94.62:35349: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
I20260808 07:09:54.452291 25333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:54.452170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:44105)
0808 07:09:54.452227 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:54.452258 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 07:09:54.452644 25333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:54.452516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:33553)
0808 07:09:54.452566 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:54.452617 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 07:09:54.452996 25331 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 07:09:54.459590 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 25192
I20260808 07:09:54.459980 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:45879
--local_ip_for_outbound_sockets=127.9.94.3
--tserver_master_addrs=127.9.94.62:35349
--webserver_port=40579
--webserver_interface=127.9.94.3
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:54.549695 25334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:54.549929 25334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:54.549957 25334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:54.551069 25334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:54.551106 25334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:54.551131 25334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:09:54.552526 25334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:45879
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=40579
--tserver_master_addrs=127.9.94.62:35349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:09:54.552719 25334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:54.552937 25334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:54.558456 25342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:54.558518 25339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:54.558455 25334 server_base.cc:1034] running on GCE node
W20260808 07:09:54.558457 25340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:54.558996 25334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:54.559288 25334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:54.560464 25334 hybrid_clock.cc:648] HybridClock initialized: now 1786172994560424 us; error 60 us; skew 500 ppm
Aug 08 07:09:54 dist-test-slave-77v9 krb5kdc[23806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172994, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:54.563397 25334 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:09:54.563956 25334 webserver.cc:460] Webserver started at http://127.9.94.3:40579/ using document root <none> and password file <none>
I20260808 07:09:54.564181 25334 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:54.564225 25334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:54.565845 25334 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:54.566638 25351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:54.566883 25334 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:54.566972 25334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "27a6306ad03045a385bebb70ab297cd5"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-77v9"
server_key: "3001eda349c0be04a39651d2c49c1b36"
server_key_iv: "37fae5718f359e22f3fe3f0b54c9e9a7"
server_key_version: "encryptionkey@0"
I20260808 07:09:54.567339 25334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:54.590665 25334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:54.593219 25334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:54.593390 25334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:54.593617 25334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:54.593962 25334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:54.594002 25334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:54.594026 25334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:54.594039 25334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:54.600782 25334 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:45879
I20260808 07:09:54.600845 25470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:45879 every 8 connection(s)
I20260808 07:09:54.601228 25334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:09:54.602420 25473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:54.602003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:44259)
0808 07:09:54.602194 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:54.602272 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":91,"threads_started":1}
W20260808 07:09:54.602830 25471 heartbeater.cc:644] Failed to heartbeat to 127.9.94.62:35349 (0 consecutive failures): Network error: Failed to ping master at 127.9.94.62:35349: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
I20260808 07:09:54.603356 25473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:54.603167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:51013)
0808 07:09:54.603293 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:54.603325 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 07:09:54.603845 25473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:54.603669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:35173)
0808 07:09:54.603782 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:54.603820 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
W20260808 07:09:54.604043 25471 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 07:09:54.607344 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 25334
I20260808 07:09:55.393729 25475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:55.393339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:39355)
0808 07:09:55.393591 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:55.393635 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":77,"threads_started":1}
I20260808 07:09:55.453691 25476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:55.453413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:59485)
0808 07:09:55.453574 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:55.453622 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":67,"threads_started":1}
I20260808 07:09:55.604669 25477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:55.604385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:49955)
0808 07:09:55.604561 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:55.604594 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":74,"threads_started":1}
I20260808 07:09:55.963158 25478 raft_consensus.cc:482] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:55.963321 25478 raft_consensus.cc:504] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:09:55.963840 25478 leader_election.cc:288] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889), 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879)
Aug 08 07:09:55 dist-test-slave-77v9 krb5kdc[23806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172994, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.2@KRBTEST.COM
Aug 08 07:09:55 dist-test-slave-77v9 krb5kdc[23806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172994, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.3@KRBTEST.COM
I20260808 07:09:55.978029 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:55.964107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:44889 (local address 127.9.94.1:47519)
0808 07:09:55.964251 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:55.964266 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:55.964330 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:55.965516 (+ 1186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:55.965519 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:55.966105 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:55.966456 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:55.966465 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:55.968671 (+ 2206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:55.968673 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:55.970015 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:55.970019 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:55.970756 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:55.970758 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:55.970881 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:55.971677 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:55.971691 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:55.973620 (+ 1929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:55.975924 (+ 2304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:55.975932 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:55.975935 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:55.976258 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:55.976532 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:55.976533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:55.976533 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:55.976688 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:55.977469 (+ 781us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:55.977477 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:55.977603 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 07:09:55.977727 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 07:09:55.977910 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":77,"thread_start_us":100,"threads_started":1}
I20260808 07:09:55.978050 25481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:55.964262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:47519 (local address 127.9.94.2:44889)
0808 07:09:55.964441 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:55.964456 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:55.964483 (+ 27us) server_negotiation.cc:407] Connection header received
0808 07:09:55.965146 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:55.965149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:55.965222 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:55.965396 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:55.966704 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:55.968487 (+ 1783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:55.970133 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:55.970639 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:55.970784 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:55.973796 (+ 3012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:55.973800 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:55.973800 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:55.973812 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:55.975817 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:55.976353 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:55.976356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:55.976356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:55.976451 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:55.976787 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:55.976788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:55.976788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:55.977250 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:55.977456 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:55.977818 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 07:09:55.977948 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":52,"threads_started":1}
I20260808 07:09:55.978545 25484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:55.964517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:58311 (local address 127.9.94.3:45879)
0808 07:09:55.964653 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:55.964660 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:55.964691 (+ 31us) server_negotiation.cc:407] Connection header received
0808 07:09:55.965249 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:55.965251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:55.965295 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:55.965423 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:55.966717 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:55.968486 (+ 1769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:55.970170 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:55.970686 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:55.970872 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:55.974526 (+ 3654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:55.974530 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:55.974530 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:55.974541 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:55.976894 (+ 2353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:55.977309 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:55.977312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:55.977313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:55.977410 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:55.977656 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:55.977657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:55.977658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:55.977903 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:55.978003 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:55.978307 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 07:09:55.978460 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260808 07:09:55.978845 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:55.964357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:45879 (local address 127.9.94.1:58311)
0808 07:09:55.964530 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:55.964542 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:55.964604 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:55.965516 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:55.965519 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:55.966105 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:55.966456 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:55.966465 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:55.968684 (+ 2219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:55.968685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:55.970034 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:55.970038 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:55.970787 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:55.970789 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:55.970888 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:55.971623 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:55.971632 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:55.974405 (+ 2773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:55.976978 (+ 2573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:55.976979 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:55.976979 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:55.977199 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:55.977503 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:55.977504 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:55.977505 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:55.977581 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:55.977987 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:55.977987 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:55.978037 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 07:09:55.978659 (+ 622us) client_negotiation.cc:240] Negotiation successful
0808 07:09:55.978769 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":113,"thread_start_us":112,"threads_started":1}
W20260808 07:09:55.979151 25072 leader_election.cc:341] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889): Not found: Tablet not found: a95b107ba605462992f207e91b72a3ac
W20260808 07:09:55.979820 25072 leader_election.cc:341] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879): Not found: Tablet not found: a95b107ba605462992f207e91b72a3ac
I20260808 07:09:55.979895 25072 leader_election.cc:302] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f478d0e895334c0bb4c0dc1550808d72; no voters: 27a6306ad03045a385bebb70ab297cd5, 81f950713eeb4e729217c238e65a31f1
I20260808 07:09:55.980130 25478 raft_consensus.cc:2726] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:09:56.394790 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:56.394515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:37217)
0808 07:09:56.394607 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:56.394669 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 07:09:56.454684 25485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:56.454415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:51549)
0808 07:09:56.454562 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:56.454620 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":69,"threads_started":1}
I20260808 07:09:56.605334 25486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:56.605101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:51617)
0808 07:09:56.605248 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:56.605286 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":64,"threads_started":1}
I20260808 07:09:57.395756 25487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:57.395476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:59273)
0808 07:09:57.395658 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:57.395705 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":79,"threads_started":1}
I20260808 07:09:57.455610 25488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:57.455338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:40267)
0808 07:09:57.455517 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:57.455561 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":78,"threads_started":1}
I20260808 07:09:57.606223 25489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:57.605963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:51929)
0808 07:09:57.606128 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:57.606175 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":77,"threads_started":1}
I20260808 07:09:58.173986 25490 raft_consensus.cc:482] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:58.174101 25490 raft_consensus.cc:504] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:09:58.174327 25490 leader_election.cc:288] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889), 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879)
W20260808 07:09:58.175009 25072 leader_election.cc:341] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889): Not found: Tablet not found: a95b107ba605462992f207e91b72a3ac
W20260808 07:09:58.175318 25072 leader_election.cc:341] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879): Not found: Tablet not found: a95b107ba605462992f207e91b72a3ac
I20260808 07:09:58.175421 25072 leader_election.cc:302] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f478d0e895334c0bb4c0dc1550808d72; no voters: 27a6306ad03045a385bebb70ab297cd5, 81f950713eeb4e729217c238e65a31f1
I20260808 07:09:58.175514 25490 raft_consensus.cc:2726] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:09:58.396965 25491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:58.396528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:44133)
0808 07:09:58.396701 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:58.396751 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":70,"threads_started":1}
I20260808 07:09:58.456470 25492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:58.456199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:57821)
0808 07:09:58.456355 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:58.456404 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":69,"threads_started":1}
I20260808 07:09:58.607187 25494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:58.606881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:36575)
0808 07:09:58.607065 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:58.607118 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":84,"threads_started":1}
I20260808 07:09:59.397951 25495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:59.397630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:48927)
0808 07:09:59.397856 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:59.397902 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":88,"threads_started":1}
I20260808 07:09:59.457535 25496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:59.457257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:51215)
0808 07:09:59.457431 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:59.457482 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":95,"threads_started":1}
I20260808 07:09:59.608503 25497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:59.608175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:39995)
0808 07:09:59.608384 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:59.608451 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":146,"threads_started":1}
I20260808 07:09:59.902038 25498 raft_consensus.cc:482] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:59.902153 25498 raft_consensus.cc:504] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:09:59.902354 25498 leader_election.cc:288] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889), 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879)
W20260808 07:09:59.903179 25072 leader_election.cc:341] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889): Not found: Tablet not found: a95b107ba605462992f207e91b72a3ac
W20260808 07:09:59.903331 25072 leader_election.cc:341] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879): Not found: Tablet not found: a95b107ba605462992f207e91b72a3ac
I20260808 07:09:59.903368 25072 leader_election.cc:302] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f478d0e895334c0bb4c0dc1550808d72; no voters: 27a6306ad03045a385bebb70ab297cd5, 81f950713eeb4e729217c238e65a31f1
I20260808 07:09:59.903475 25498 raft_consensus.cc:2726] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:10:00.399051 25500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:00.398711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:60663)
0808 07:10:00.398943 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:00.398992 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":81,"threads_started":1}
I20260808 07:10:00.458467 25501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:00.458186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:37197)
0808 07:10:00.458369 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:00.458416 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":81,"threads_started":1}
I20260808 07:10:00.609849 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:00.609481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:57337)
0808 07:10:00.609747 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:00.609796 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":75,"threads_started":1}
I20260808 07:10:01.400266 25503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.399819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:57329)
0808 07:10:01.400135 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.400191 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":150,"threads_started":1}
I20260808 07:10:01.459591 25504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.459293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:47795)
0808 07:10:01.459481 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.459534 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":80,"threads_started":1}
I20260808 07:10:01.520954 25505 raft_consensus.cc:482] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:10:01.521284 25505 raft_consensus.cc:504] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:10:01.521632 25505 leader_election.cc:288] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889), 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879)
W20260808 07:10:01.522342 25072 leader_election.cc:341] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879): Not found: Tablet not found: a95b107ba605462992f207e91b72a3ac
W20260808 07:10:01.522456 25072 leader_election.cc:341] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889): Not found: Tablet not found: a95b107ba605462992f207e91b72a3ac
I20260808 07:10:01.522495 25072 leader_election.cc:302] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f478d0e895334c0bb4c0dc1550808d72; no voters: 27a6306ad03045a385bebb70ab297cd5, 81f950713eeb4e729217c238e65a31f1
I20260808 07:10:01.522635 25505 raft_consensus.cc:2726] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:10:01.610837 25506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.610557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:34331)
0808 07:10:01.610732 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.610781 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":90,"threads_started":1}
I20260808 07:10:02.401616 25507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:02.401201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:43861)
0808 07:10:02.401463 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:02.401541 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":93,"threads_started":1}
I20260808 07:10:02.460541 25508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:02.460251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:60635)
0808 07:10:02.460426 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:02.460483 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":83,"threads_started":1}
I20260808 07:10:02.611915 25509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:02.611588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:45291)
0808 07:10:02.611769 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:02.611806 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":74,"threads_started":1}
I20260808 07:10:03.402899 25510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:03.402590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:55855)
0808 07:10:03.402798 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:03.402846 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":94,"threads_started":1}
I20260808 07:10:03.461445 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:03.461154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:45003)
0808 07:10:03.461345 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:03.461393 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":76,"threads_started":1}
I20260808 07:10:03.613163 25512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:03.612726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:33295)
0808 07:10:03.613064 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:03.613108 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":230,"threads_started":1}
I20260808 07:10:04.404014 25513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.403691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:49541)
0808 07:10:04.403923 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.403967 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":87,"threads_started":1}
I20260808 07:10:04.462507 25514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.462182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:50459)
0808 07:10:04.462405 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.462455 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":120,"threads_started":1}
I20260808 07:10:04.614161 25515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.613876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:33659)
0808 07:10:04.614044 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.614100 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":77,"threads_started":1}
I20260808 07:10:05.405071 25516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:05.404726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:51433)
0808 07:10:05.404974 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:05.405021 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":186,"threads_started":1}
I20260808 07:10:05.463791 25517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:05.463356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:50469)
0808 07:10:05.463663 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:05.463721 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":108,"threads_started":1}
I20260808 07:10:05.615242 25518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:05.614829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:53035)
0808 07:10:05.615079 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:05.615167 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":78,"threads_started":1}
I20260808 07:10:06.406291 25519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:06.405955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:50131)
0808 07:10:06.406180 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:06.406238 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":91,"threads_started":1}
I20260808 07:10:06.464803 25520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:06.464547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:44201)
0808 07:10:06.464702 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:06.464750 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":75,"threads_started":1}
I20260808 07:10:06.616264 25521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:06.615949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:40347)
0808 07:10:06.616158 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:06.616199 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":94,"threads_started":1}
I20260808 07:10:07.263018 25522 raft_consensus.cc:482] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:10:07.263132 25522 raft_consensus.cc:504] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f950713eeb4e729217c238e65a31f1" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 44889 } } peers { permanent_uuid: "27a6306ad03045a385bebb70ab297cd5" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45879 } } peers { permanent_uuid: "f478d0e895334c0bb4c0dc1550808d72" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44047 } }
I20260808 07:10:07.263267 25522 leader_election.cc:288] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889), 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879)
W20260808 07:10:07.263727 25072 leader_election.cc:341] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 27a6306ad03045a385bebb70ab297cd5 (127.9.94.3:45879): Not found: Tablet not found: a95b107ba605462992f207e91b72a3ac
W20260808 07:10:07.263808 25072 leader_election.cc:341] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 81f950713eeb4e729217c238e65a31f1 (127.9.94.2:44889): Not found: Tablet not found: a95b107ba605462992f207e91b72a3ac
I20260808 07:10:07.263828 25072 leader_election.cc:302] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f478d0e895334c0bb4c0dc1550808d72; no voters: 27a6306ad03045a385bebb70ab297cd5, 81f950713eeb4e729217c238e65a31f1
I20260808 07:10:07.263955 25522 raft_consensus.cc:2726] T a95b107ba605462992f207e91b72a3ac P f478d0e895334c0bb4c0dc1550808d72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:10:07.407389 25523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:07.407067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:43847)
0808 07:10:07.407292 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:07.407340 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":104,"threads_started":1}
I20260808 07:10:07.466068 25524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:07.465785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:53277)
0808 07:10:07.465959 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:07.466006 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":173,"threads_started":1}
I20260808 07:10:07.617179 25525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:07.616911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:52673)
0808 07:10:07.617089 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:07.617128 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":88,"threads_started":1}
I20260808 07:10:08.408354 25526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:08.408083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:52437)
0808 07:10:08.408255 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:08.408304 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":78,"threads_started":1}
I20260808 07:10:08.467341 25527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:08.466927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:38727)
0808 07:10:08.467175 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:08.467269 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":78,"threads_started":1}
I20260808 07:10:08.618257 25528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:08.617909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:51317)
0808 07:10:08.618151 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:08.618200 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":84,"threads_started":1}
I20260808 07:10:09.409821 25529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:09.409410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.1:48833)
0808 07:10:09.409687 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:09.409766 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":135,"threads_started":1}
I20260808 07:10:09.468547 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:09.468276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.2:57735)
0808 07:10:09.468447 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:09.468496 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":81,"threads_started":1}
I20260808 07:10:09.613668 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 25022
I20260808 07:10:09.619272 25531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:09.619022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:35349 (local address 127.9.94.3:51017)
0808 07:10:09.619175 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:09.619221 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:35349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":78,"threads_started":1}
I20260808 07:10:09.621124 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 25192
I20260808 07:10:09.627096 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 25334
2026-08-08T07:10:09Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18777 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:10:09 dist-test-slave-77v9 krb5kdc[25534](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:10:09 dist-test-slave-77v9 krb5kdc[25534](info): set up 2 sockets
Aug 08 07:10:09 dist-test-slave-77v9 krb5kdc[25534](info): commencing operation
krb5kdc: starting...
W20260808 07:10:10.803601 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:10:10 dist-test-slave-77v9 krb5kdc[25534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:10:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:10:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:10:10.953140 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:33957
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:33957
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:10:11.049142 25547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:11.049376 25547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:11.049398 25547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:11.050603 25547 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 07:10:11.050650 25547 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 07:10:11.050662 25547 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 07:10:11.050674 25547 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:10:11.050688 25547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:11.050700 25547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:11.050712 25547 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:10:11.050724 25547 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:10:11.052265 25547 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:33957
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:33957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:10:11.052491 25547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:11.052676 25547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:11.058373 25552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:11.058413 25555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:11.058463 25547 server_base.cc:1034] running on GCE node
W20260808 07:10:11.058413 25553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:11.059049 25547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:11.059324 25547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:11.060488 25547 hybrid_clock.cc:648] HybridClock initialized: now 1786173011060472 us; error 34 us; skew 500 ppm
Aug 08 07:10:11 dist-test-slave-77v9 krb5kdc[25534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173011, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:11.063421 25547 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:10:11.063980 25547 webserver.cc:460] Webserver started at http://127.9.94.62:46031/ using document root <none> and password file <none>
I20260808 07:10:11.064258 25547 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:11.064332 25547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:11.064496 25547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:10:11.065759 25547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "e3ccd52faf9f4480897152fe2297abe3"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "8cca70fe962e4af5bcc89735c3acf273"
server_key_iv: "c82f6208a9976c0dec6b3d15d14a37e9"
server_key_version: "encryptionkey@0"
I20260808 07:10:11.066273 25547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "e3ccd52faf9f4480897152fe2297abe3"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "8cca70fe962e4af5bcc89735c3acf273"
server_key_iv: "c82f6208a9976c0dec6b3d15d14a37e9"
server_key_version: "encryptionkey@0"
I20260808 07:10:11.067873 25547 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:10:11.069051 25562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:11.069247 25547 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:10:11.069360 25547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "e3ccd52faf9f4480897152fe2297abe3"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "8cca70fe962e4af5bcc89735c3acf273"
server_key_iv: "c82f6208a9976c0dec6b3d15d14a37e9"
server_key_version: "encryptionkey@0"
I20260808 07:10:11.069624 25547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:11.086351 25547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:11.089155 25547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:11.089357 25547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:11.094343 25547 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:33957
I20260808 07:10:11.094415 25617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:33957 every 8 connection(s)
I20260808 07:10:11.094805 25547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:10:11.095763 25618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:10:11.098323 25618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Bootstrap starting.
I20260808 07:10:11.098955 25618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Neither blocks nor log segments found. Creating new log.
I20260808 07:10:11.099228 25618 log.cc:824] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Log is configured to *not* fsync() on all Append() calls
I20260808 07:10:11.100023 25618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: No bootstrap required, opened a new log
I20260808 07:10:11.100540 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 25547
I20260808 07:10:11.100654 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:10:11.100965 9592 external_mini_cluster.cc:1428] Setting key a6e05ad4bc0460df96e2bd1fe986d859
I20260808 07:10:11.102517 25618 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } }
I20260808 07:10:11.102703 25618 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:10:11.102744 25618 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ccd52faf9f4480897152fe2297abe3, State: Initialized, Role: FOLLOWER
I20260808 07:10:11.102944 25618 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } }
I20260808 07:10:11.103050 25618 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:10:11.103094 25618 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:10:11.103153 25618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:10:11.104280 25618 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } }
I20260808 07:10:11.104378 25618 leader_election.cc:302] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3ccd52faf9f4480897152fe2297abe3; no voters:
I20260808 07:10:11.104583 25618 leader_election.cc:288] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:10:11.104635 25623 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:10:11.104895 25618 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:10:11.104830 25623 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 1 LEADER]: Becoming Leader. State: Replica: e3ccd52faf9f4480897152fe2297abe3, State: Running, Role: LEADER
I20260808 07:10:11.105191 25623 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } }
I20260808 07:10:11.105630 25624 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3ccd52faf9f4480897152fe2297abe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } } }
I20260808 07:10:11.105736 25624 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:10:11.106130 25626 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3ccd52faf9f4480897152fe2297abe3. Latest consensus state: current_term: 1 leader_uuid: "e3ccd52faf9f4480897152fe2297abe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } } }
I20260808 07:10:11.106208 25626 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:10:11.106447 25635 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:10:11.107085 25635 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 07:10:11 dist-test-slave-77v9 krb5kdc[25534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:10:11.109455 25635 catalog_manager.cc:1347] Generated new cluster ID: 7b8a825bc800472495c72dad3cfbe8e7
I20260808 07:10:11.109513 25635 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:10:11.114614 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.101594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51008 (local address 127.9.94.62:33957)
0808 07:10:11.101789 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:11.101797 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:11.101836 (+ 39us) server_negotiation.cc:407] Connection header received
0808 07:10:11.102499 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:11.102506 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:11.102569 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:11.102690 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:11.103699 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.104989 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.106159 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.106826 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.106932 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.109910 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:11.109915 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:11.109915 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:11.109929 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:11.112011 (+ 2082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:11.112511 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:11.112514 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:11.112514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:11.112644 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:11.113014 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:11.113015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:11.113015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:11.113400 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:11.113612 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:11.113796 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 07:10:11.114350 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":112,"threads_started":1}
I20260808 07:10:11.127912 25635 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:10:11.128451 25635 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:10:11.140501 25635 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Generated new TSK 0
I20260808 07:10:11.140717 25635 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:10:11.176964 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:33957
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:10:11.272706 25647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:11.273020 25647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:11.273047 25647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:11.274269 25647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:11.274318 25647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:11.274345 25647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:10:11.275902 25647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:33957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:10:11.276115 25647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:11.276311 25647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:10:11.281756 25647 server_base.cc:1034] running on GCE node
W20260808 07:10:11.281724 25656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:11.281720 25654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:11.281714 25652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:11.282366 25647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:11.282619 25647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:11.283785 25647 hybrid_clock.cc:648] HybridClock initialized: now 1786173011283769 us; error 42 us; skew 500 ppm
Aug 08 07:10:11 dist-test-slave-77v9 krb5kdc[25534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173011, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:11.286952 25647 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:10:11.287496 25647 webserver.cc:460] Webserver started at http://127.9.94.1:40017/ using document root <none> and password file <none>
I20260808 07:10:11.287732 25647 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:11.287781 25647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:11.287895 25647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:10:11.289150 25647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "9150e6c7223d488cb20f403aab311967"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "1df1e17014ad13166efd3824b3dd23e7"
server_key_iv: "2c4e9a31b98334648b4bd3aecc270d40"
server_key_version: "encryptionkey@0"
I20260808 07:10:11.289500 25647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "9150e6c7223d488cb20f403aab311967"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "1df1e17014ad13166efd3824b3dd23e7"
server_key_iv: "2c4e9a31b98334648b4bd3aecc270d40"
server_key_version: "encryptionkey@0"
I20260808 07:10:11.291169 25647 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:10:11.292053 25663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:11.292342 25647 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:10:11.292445 25647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "9150e6c7223d488cb20f403aab311967"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "1df1e17014ad13166efd3824b3dd23e7"
server_key_iv: "2c4e9a31b98334648b4bd3aecc270d40"
server_key_version: "encryptionkey@0"
I20260808 07:10:11.292505 25647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:11.307013 25647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:11.309674 25647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:11.309809 25647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:11.310030 25647 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:10:11.310389 25647 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:10:11.310428 25647 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:11.310475 25647 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:10:11.310506 25647 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:11.317265 25647 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:37021
I20260808 07:10:11.317308 25780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:37021 every 8 connection(s)
I20260808 07:10:11.317705 25647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:10:11 dist-test-slave-77v9 krb5kdc[25534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173011, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:10:11.324712 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 25647
I20260808 07:10:11.324878 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:10:11.325112 9592 external_mini_cluster.cc:1428] Setting key 37dbcb5a3e87393c44d7120e99f709cd
I20260808 07:10:11.328220 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.318586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:59675 (local address 127.9.94.62:33957)
0808 07:10:11.318657 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:11.318659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:11.318874 (+ 215us) server_negotiation.cc:407] Connection header received
0808 07:10:11.319423 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:11.319424 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:11.319441 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:11.319500 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:11.320514 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.321131 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.322128 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.322341 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.322426 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.324755 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:11.324757 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:11.324757 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:11.324765 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:11.326520 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:11.327059 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:11.327060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:11.327061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:11.327122 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:11.327415 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:11.327415 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:11.327415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:11.327532 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:11.327588 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:11.327967 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 07:10:11.328081 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 07:10:11.328233 25785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.318563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:59675)
0808 07:10:11.318747 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:11.318785 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:11.319313 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:11.319581 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:11.319585 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:11.320184 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:11.320377 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.320381 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.321239 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.321240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.322036 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.322038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.322444 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.322445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.322563 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.323111 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:11.323119 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:11.324652 (+ 1533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:11.326616 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:11.326625 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:11.326627 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:11.326973 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:11.327194 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:11.327195 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:11.327195 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:11.327343 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:11.327597 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:11.327603 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:11.327791 (+ 188us) client_negotiation.cc:769] Sending connection context
0808 07:10:11.327928 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 07:10:11.328062 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
I20260808 07:10:11.328861 25781 heartbeater.cc:347] Connected to a master server at 127.9.94.62:33957
I20260808 07:10:11.328994 25781 heartbeater.cc:464] Registering TS with master...
I20260808 07:10:11.329234 25781 heartbeater.cc:511] Master 127.9.94.62:33957 requested a full tablet report, sending...
I20260808 07:10:11.329762 25580 ts_manager.cc:194] Registered new tserver with Master: 9150e6c7223d488cb20f403aab311967 (127.9.94.1:37021)
I20260808 07:10:11.330418 25580 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:59675
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:10:11.357046 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:33957
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:10:11.449776 25788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:11.450012 25788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:11.450038 25788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:11.451241 25788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:11.451283 25788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:11.451311 25788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:10:11.452867 25788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:33957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:10:11.453236 25788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:11.453517 25788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:11.459124 25796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:11.459115 25793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:11.459115 25794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:11.459394 25788 server_base.cc:1034] running on GCE node
I20260808 07:10:11.459632 25788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:11.459919 25788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:11.461108 25788 hybrid_clock.cc:648] HybridClock initialized: now 1786173011461084 us; error 42 us; skew 500 ppm
Aug 08 07:10:11 dist-test-slave-77v9 krb5kdc[25534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173011, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:11.464154 25788 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:10:11.464664 25788 webserver.cc:460] Webserver started at http://127.9.94.2:35635/ using document root <none> and password file <none>
I20260808 07:10:11.464942 25788 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:11.464998 25788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:11.465099 25788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:10:11.466223 25788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "ae41a86becd97feef95a2838832efbcd"
server_key_iv: "345eb29c9d63d8ec8ffeff474e1d8240"
server_key_version: "encryptionkey@0"
I20260808 07:10:11.466580 25788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "ae41a86becd97feef95a2838832efbcd"
server_key_iv: "345eb29c9d63d8ec8ffeff474e1d8240"
server_key_version: "encryptionkey@0"
I20260808 07:10:11.468118 25788 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:10:11.468987 25804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:11.469182 25788 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:10:11.469273 25788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "ae41a86becd97feef95a2838832efbcd"
server_key_iv: "345eb29c9d63d8ec8ffeff474e1d8240"
server_key_version: "encryptionkey@0"
I20260808 07:10:11.469362 25788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:11.484728 25788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:11.487035 25788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:11.487301 25788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:11.487727 25788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:10:11.488150 25788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:10:11.488193 25788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:11.488217 25788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:10:11.488231 25788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:11.494858 25788 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:40329
I20260808 07:10:11.494936 25924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:40329 every 8 connection(s)
I20260808 07:10:11.495298 25788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:10:11 dist-test-slave-77v9 krb5kdc[25534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173011, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:10:11.503575 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 25788
I20260808 07:10:11.503712 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:10:11.503968 9592 external_mini_cluster.cc:1428] Setting key 846b8241c6f355c4d3700212a904d1e7
I20260808 07:10:11.506410 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.496199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:44829 (local address 127.9.94.62:33957)
0808 07:10:11.496257 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:11.496259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:11.496507 (+ 248us) server_negotiation.cc:407] Connection header received
0808 07:10:11.497186 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:11.497188 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:11.497202 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:11.497268 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:11.498339 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.498899 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.500078 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.500294 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.500387 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.502775 (+ 2388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:11.502778 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:11.502778 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:11.502786 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:11.504528 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:11.505115 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:11.505117 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:11.505117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:11.505190 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:11.505514 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:11.505515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:11.505515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:11.505682 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:11.505783 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:11.506146 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 07:10:11.506254 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:10:11.506520 25927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.496160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:44829)
0808 07:10:11.496376 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:11.496415 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:11.497062 (+ 647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:11.497340 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:11.497345 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:11.498000 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:11.498228 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.498233 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.499003 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.499004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.499977 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.499981 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.500399 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.500400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.500538 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.501163 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:11.501172 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:11.502652 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:11.504628 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:11.504637 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:11.504640 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:11.505003 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:11.505277 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:11.505277 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:11.505278 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:11.505432 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:11.505826 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:11.505834 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:11.505980 (+ 146us) client_negotiation.cc:769] Sending connection context
0808 07:10:11.506084 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 07:10:11.506292 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":103,"threads_started":1}
I20260808 07:10:11.507196 25925 heartbeater.cc:347] Connected to a master server at 127.9.94.62:33957
I20260808 07:10:11.507339 25925 heartbeater.cc:464] Registering TS with master...
I20260808 07:10:11.507562 25925 heartbeater.cc:511] Master 127.9.94.62:33957 requested a full tablet report, sending...
I20260808 07:10:11.508069 25580 ts_manager.cc:194] Registered new tserver with Master: bb3bdf0773c34a0e9ec0ac9c37787fc7 (127.9.94.2:40329)
I20260808 07:10:11.508710 25580 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:44829
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:10:11.537508 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:33957
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:10:11.629361 25930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:11.629628 25930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:11.629674 25930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:11.630995 25930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:11.631068 25930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:11.631119 25930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:10:11.632805 25930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:33957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:10:11.633162 25930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:11.633435 25930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:11.639258 25940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:11.639402 25930 server_base.cc:1034] running on GCE node
W20260808 07:10:11.639213 25938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:11.639207 25936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:11.640039 25930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:11.640334 25930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:11.641489 25930 hybrid_clock.cc:648] HybridClock initialized: now 1786173011641476 us; error 34 us; skew 500 ppm
Aug 08 07:10:11 dist-test-slave-77v9 krb5kdc[25534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173011, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:11.644244 25930 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:10:11.644708 25930 webserver.cc:460] Webserver started at http://127.9.94.3:40235/ using document root <none> and password file <none>
I20260808 07:10:11.645005 25930 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:11.645056 25930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:11.645149 25930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:10:11.646268 25930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "52028fb4ab3d4af1a2c6adc86989ceeb"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "43ea61e9728cd4c584e721694181af9d"
server_key_iv: "87dd54bc6d666b5798a607cd7698f406"
server_key_version: "encryptionkey@0"
I20260808 07:10:11.646648 25930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "52028fb4ab3d4af1a2c6adc86989ceeb"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "43ea61e9728cd4c584e721694181af9d"
server_key_iv: "87dd54bc6d666b5798a607cd7698f406"
server_key_version: "encryptionkey@0"
I20260808 07:10:11.648033 25930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:10:11.648916 25947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:11.649183 25930 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:10:11.649309 25930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "52028fb4ab3d4af1a2c6adc86989ceeb"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "43ea61e9728cd4c584e721694181af9d"
server_key_iv: "87dd54bc6d666b5798a607cd7698f406"
server_key_version: "encryptionkey@0"
I20260808 07:10:11.649394 25930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:11.674191 25930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:11.677035 25930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:11.677222 25930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:11.677512 25930 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:10:11.677870 25930 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:10:11.677927 25930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:11.677974 25930 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:10:11.678007 25930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:11.685216 25930 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:35741
I20260808 07:10:11.685312 26064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:35741 every 8 connection(s)
I20260808 07:10:11.685701 25930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:10:11 dist-test-slave-77v9 krb5kdc[25534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173011, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:10:11.694926 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 25930
I20260808 07:10:11.695194 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:10:11.695415 9592 external_mini_cluster.cc:1428] Setting key 69c04bc358a6feefaecd0b436bab85b7
I20260808 07:10:11.697115 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.686890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:36993 (local address 127.9.94.62:33957)
0808 07:10:11.686974 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:11.686976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:11.686997 (+ 21us) server_negotiation.cc:407] Connection header received
0808 07:10:11.687590 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:11.687593 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:11.687609 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:11.687686 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:11.688910 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.689507 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.690681 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.690936 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.691011 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.693651 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:11.693653 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:11.693653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:11.693662 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:11.695330 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:11.695882 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:11.695884 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:11.695884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:11.695958 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:11.696314 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:11.696315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:11.696315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:11.696463 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:11.696549 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:11.696956 (+ 407us) server_negotiation.cc:299] Negotiation successful
0808 07:10:11.697042 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 07:10:11.697328 26067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.686573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:36993)
0808 07:10:11.686813 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:11.686862 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:11.687423 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:11.687789 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:11.687793 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:11.688496 (+ 703us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:11.688713 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.688717 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.689631 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.689632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.690556 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.690559 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.691049 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.691050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.691170 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.691840 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:11.691848 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:11.693545 (+ 1697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:11.695451 (+ 1906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:11.695458 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:11.695461 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:11.695743 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:11.696038 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:11.696040 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:11.696040 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:11.696211 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:11.696552 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:11.696559 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:11.696715 (+ 156us) client_negotiation.cc:769] Sending connection context
0808 07:10:11.696879 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 07:10:11.697062 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":160,"threads_started":1}
I20260808 07:10:11.698323 26065 heartbeater.cc:347] Connected to a master server at 127.9.94.62:33957
I20260808 07:10:11.698431 26065 heartbeater.cc:464] Registering TS with master...
I20260808 07:10:11.698637 26065 heartbeater.cc:511] Master 127.9.94.62:33957 requested a full tablet report, sending...
I20260808 07:10:11.699085 25580 ts_manager.cc:194] Registered new tserver with Master: 52028fb4ab3d4af1a2c6adc86989ceeb (127.9.94.3:35741)
I20260808 07:10:11.699461 25580 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:36993
I20260808 07:10:11.707652 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:10:11.715274 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.709256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51022 (local address 127.9.94.62:33957)
0808 07:10:11.709344 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:11.709347 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:11.709430 (+ 83us) server_negotiation.cc:407] Connection header received
0808 07:10:11.709537 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:11.709538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:11.709553 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:11.709612 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:11.710211 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.710699 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.711425 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.711617 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.711699 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.712949 (+ 1250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:11.712951 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:11.712951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:11.712959 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:11.714104 (+ 1145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:11.714444 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:11.714445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:11.714445 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:11.714504 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:11.714696 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:11.714697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:11.714697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:11.714864 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:11.714969 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:11.715085 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 07:10:11.715167 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 07:10:11.717368 25580 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51022:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:10:11.719252 25580 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:10:11.726606 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.721986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:40329 (local address 127.0.0.1:33854)
0808 07:10:11.722399 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:11.722410 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:11.722463 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:11.722779 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:11.722783 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:11.722785 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:10:11.722869 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.722871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.724238 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.724239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.725507 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.725510 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.726229 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.726230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.726340 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.726359 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 07:10:11.726449 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 07:10:11.726508 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":6,"thread_start_us":109,"threads_started":1}
I20260808 07:10:11.726640 26080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.722216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33854 (local address 127.9.94.2:40329)
0808 07:10:11.722418 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:11.722424 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:11.722462 (+ 38us) server_negotiation.cc:407] Connection header received
0808 07:10:11.722543 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:11.722546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:11.722565 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:11.722663 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:10:11.722960 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.724132 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.725607 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.726123 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.726226 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.726333 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:11.726492 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 07:10:11.726547 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":92,"threads_started":1}
I20260808 07:10:11.727515 26081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.722235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:37021 (local address 127.0.0.1:46576)
0808 07:10:11.722669 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:11.722681 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:11.722749 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:11.723036 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:11.723037 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:11.723039 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:10:11.723074 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.723075 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.724003 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.724004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.725507 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.725510 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.727271 (+ 1761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.727272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.727337 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.727343 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:10:11.727400 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 07:10:11.727444 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":2,"thread_start_us":76,"threads_started":1}
I20260808 07:10:11.727547 26082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.722489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46576 (local address 127.9.94.1:37021)
0808 07:10:11.722888 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:11.722893 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:11.722903 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:10:11.722946 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:11.722948 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:11.722964 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:11.723041 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:10:11.723138 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.723891 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.726385 (+ 2494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.727206 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.727270 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.727323 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:11.727414 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 07:10:11.727467 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":82,"threads_started":1}
I20260808 07:10:11.727825 26077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.721977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:35741 (local address 127.0.0.1:33464)
0808 07:10:11.722122 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:11.722185 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:11.722262 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:11.722822 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:11.722822 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:11.722825 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:10:11.722886 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.722888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.725622 (+ 2734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.725623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.726403 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.726405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.727548 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.727549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.727620 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.727624 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:10:11.727678 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 07:10:11.727723 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
I20260808 07:10:11.727771 25855 tablet_service.cc:1467] Processing CreateTablet for tablet e8f877c4b0b0498cae230d15ec43a607 (DEFAULT_TABLE table=test-table [id=ed43aaa8abaf4805a28253e98d26bf5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:10:11.728194 25712 tablet_service.cc:1467] Processing CreateTablet for tablet e8f877c4b0b0498cae230d15ec43a607 (DEFAULT_TABLE table=test-table [id=ed43aaa8abaf4805a28253e98d26bf5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:10:11.728276 26079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.722101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33464 (local address 127.9.94.3:35741)
0808 07:10:11.722593 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:11.722598 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:11.722609 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:10:11.722648 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:11.722651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:11.722666 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:11.722738 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:10:11.723035 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.724128 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.726543 (+ 2415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.727377 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.727451 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.727506 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:11.728108 (+ 602us) server_negotiation.cc:299] Negotiation successful
0808 07:10:11.728167 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":107,"threads_started":1}
I20260808 07:10:11.728308 25855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8f877c4b0b0498cae230d15ec43a607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:10:11.728439 25712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8f877c4b0b0498cae230d15ec43a607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:10:11.728899 25996 tablet_service.cc:1467] Processing CreateTablet for tablet e8f877c4b0b0498cae230d15ec43a607 (DEFAULT_TABLE table=test-table [id=ed43aaa8abaf4805a28253e98d26bf5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:10:11.729197 25996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8f877c4b0b0498cae230d15ec43a607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:10:11.731726 26083 tablet_bootstrap.cc:492] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: Bootstrap starting.
I20260808 07:10:11.731945 26084 tablet_bootstrap.cc:492] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Bootstrap starting.
I20260808 07:10:11.732415 26085 tablet_bootstrap.cc:492] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb: Bootstrap starting.
I20260808 07:10:11.732671 26084 tablet_bootstrap.cc:654] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Neither blocks nor log segments found. Creating new log.
I20260808 07:10:11.732719 26083 tablet_bootstrap.cc:654] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: Neither blocks nor log segments found. Creating new log.
I20260808 07:10:11.733074 26085 tablet_bootstrap.cc:654] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb: Neither blocks nor log segments found. Creating new log.
I20260808 07:10:11.733431 26084 log.cc:824] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Log is configured to *not* fsync() on all Append() calls
I20260808 07:10:11.733646 26083 log.cc:824] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: Log is configured to *not* fsync() on all Append() calls
I20260808 07:10:11.733709 26085 log.cc:824] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb: Log is configured to *not* fsync() on all Append() calls
I20260808 07:10:11.734306 26084 tablet_bootstrap.cc:492] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7: No bootstrap required, opened a new log
I20260808 07:10:11.734393 26084 ts_tablet_manager.cc:1397] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 07:10:11.734670 26085 tablet_bootstrap.cc:492] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb: No bootstrap required, opened a new log
I20260808 07:10:11.734753 26085 ts_tablet_manager.cc:1397] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:10:11.736763 26084 raft_consensus.cc:348] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:11.736757 26085 raft_consensus.cc:348] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:11.737003 26084 raft_consensus.cc:374] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:10:11.737008 26085 raft_consensus.cc:374] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:10:11.737047 26085 raft_consensus.cc:729] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52028fb4ab3d4af1a2c6adc86989ceeb, State: Initialized, Role: FOLLOWER
I20260808 07:10:11.737047 26084 raft_consensus.cc:729] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb3bdf0773c34a0e9ec0ac9c37787fc7, State: Initialized, Role: FOLLOWER
I20260808 07:10:11.737205 26085 consensus_queue.cc:260] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:11.737205 26084 consensus_queue.cc:260] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:11.737283 26083 tablet_bootstrap.cc:492] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: No bootstrap required, opened a new log
I20260808 07:10:11.737373 26083 ts_tablet_manager.cc:1397] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20260808 07:10:11.737514 26085 ts_tablet_manager.cc:1428] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:10:11.737730 26084 ts_tablet_manager.cc:1428] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260808 07:10:11.737653 26065 heartbeater.cc:503] Master 127.9.94.62:33957 was elected leader, sending a full tablet report...
I20260808 07:10:11.738171 25925 heartbeater.cc:503] Master 127.9.94.62:33957 was elected leader, sending a full tablet report...
I20260808 07:10:11.739769 26083 raft_consensus.cc:348] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:11.739959 26083 raft_consensus.cc:374] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:10:11.740011 26083 raft_consensus.cc:729] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9150e6c7223d488cb20f403aab311967, State: Initialized, Role: FOLLOWER
I20260808 07:10:11.740134 26083 consensus_queue.cc:260] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:11.740445 26083 ts_tablet_manager.cc:1428] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 07:10:11.740522 25781 heartbeater.cc:503] Master 127.9.94.62:33957 was elected leader, sending a full tablet report...
W20260808 07:10:11.746073 25926 tablet.cc:2369] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:10:11.818580 25784 tablet.cc:2369] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:10:11.830826 26090 raft_consensus.cc:482] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:10:11.830987 26090 raft_consensus.cc:504] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:11.831461 26090 leader_election.cc:288] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52028fb4ab3d4af1a2c6adc86989ceeb (127.9.94.3:35741), 9150e6c7223d488cb20f403aab311967 (127.9.94.1:37021)
I20260808 07:10:11.834911 26079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.831993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:50869 (local address 127.9.94.3:35741)
0808 07:10:11.832054 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:11.832057 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:11.832070 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:10:11.832105 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:11.832106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:11.832121 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:11.832212 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:10:11.832421 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.833031 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.834073 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.834493 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.834597 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.834610 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:11.834786 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 07:10:11.834832 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:10:11.834961 25927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.831761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:35741 (local address 127.9.94.2:50869)
0808 07:10:11.831833 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:11.831847 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:11.831901 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:11.832242 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:11.832244 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:11.832247 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:10:11.832328 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.832330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.833117 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.833118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.833968 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.833970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.834598 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.834599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.834689 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.834692 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:10:11.834778 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 07:10:11.834827 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 07:10:11.834985 26082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.832088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:58155 (local address 127.9.94.1:37021)
0808 07:10:11.832137 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:11.832140 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:11.832253 (+ 113us) server_negotiation.cc:407] Connection header received
0808 07:10:11.832324 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:11.832325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:11.832339 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:11.832417 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:10:11.832590 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.833179 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.834187 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.834592 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.834681 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.834692 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:11.834855 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 07:10:11.834908 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:10:11.835088 26093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.831955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:37021 (local address 127.9.94.2:58155)
0808 07:10:11.832167 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:11.832178 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:11.832259 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:11.832434 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:11.832435 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:11.832437 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:10:11.832515 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.832516 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.833269 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.833270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.834090 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:11.834092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.834683 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.834684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:11.834764 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.834768 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:10:11.834835 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 07:10:11.834882 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":156,"threads_started":1}
I20260808 07:10:11.835716 26017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f877c4b0b0498cae230d15ec43a607" candidate_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" is_pre_election: true
I20260808 07:10:11.835712 25733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f877c4b0b0498cae230d15ec43a607" candidate_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9150e6c7223d488cb20f403aab311967" is_pre_election: true
I20260808 07:10:11.835901 25733 raft_consensus.cc:2454] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb3bdf0773c34a0e9ec0ac9c37787fc7 in term 0.
I20260808 07:10:11.835898 26017 raft_consensus.cc:2454] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb3bdf0773c34a0e9ec0ac9c37787fc7 in term 0.
I20260808 07:10:11.836189 25808 leader_election.cc:302] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9150e6c7223d488cb20f403aab311967, bb3bdf0773c34a0e9ec0ac9c37787fc7; no voters:
I20260808 07:10:11.836349 26090 raft_consensus.cc:2781] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:10:11.836453 26090 raft_consensus.cc:482] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:10:11.836498 26090 raft_consensus.cc:3037] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:10:11.837451 26090 raft_consensus.cc:504] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:11.837616 26090 leader_election.cc:288] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [CANDIDATE]: Term 1 election: Requested vote from peers 52028fb4ab3d4af1a2c6adc86989ceeb (127.9.94.3:35741), 9150e6c7223d488cb20f403aab311967 (127.9.94.1:37021)
I20260808 07:10:11.837898 26017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f877c4b0b0498cae230d15ec43a607" candidate_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb"
I20260808 07:10:11.837993 25733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f877c4b0b0498cae230d15ec43a607" candidate_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9150e6c7223d488cb20f403aab311967"
I20260808 07:10:11.838006 26017 raft_consensus.cc:3037] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:10:11.838068 25733 raft_consensus.cc:3037] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:10:11.839020 26017 raft_consensus.cc:2454] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb3bdf0773c34a0e9ec0ac9c37787fc7 in term 1.
I20260808 07:10:11.839056 25733 raft_consensus.cc:2454] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb3bdf0773c34a0e9ec0ac9c37787fc7 in term 1.
I20260808 07:10:11.839233 25808 leader_election.cc:302] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52028fb4ab3d4af1a2c6adc86989ceeb, bb3bdf0773c34a0e9ec0ac9c37787fc7; no voters:
I20260808 07:10:11.839354 26090 raft_consensus.cc:2781] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:10:11.839531 26090 raft_consensus.cc:686] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 1 LEADER]: Becoming Leader. State: Replica: bb3bdf0773c34a0e9ec0ac9c37787fc7, State: Running, Role: LEADER
I20260808 07:10:11.839650 26090 consensus_queue.cc:237] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:11.840633 25579 catalog_manager.cc:5495] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb3bdf0773c34a0e9ec0ac9c37787fc7 (127.9.94.2). New cstate: current_term: 1 leader_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } health_report { overall_health: UNKNOWN } } }
I20260808 07:10:11.873202 26080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.870125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33864 (local address 127.9.94.2:40329)
0808 07:10:11.870189 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:11.870191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:11.870205 (+ 14us) server_negotiation.cc:407] Connection header received
0808 07:10:11.870288 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:11.870289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:11.870323 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:11.870394 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:10:11.870603 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.871149 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.872077 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:11.872280 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:11.872527 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:11.872689 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:10:11.872857 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:10:11.872943 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:11.873005 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 07:10:11.873048 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 07:10:11.875319 26017 raft_consensus.cc:1261] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 1 FOLLOWER]: Refusing update from remote peer bb3bdf0773c34a0e9ec0ac9c37787fc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:10:11.875344 25733 raft_consensus.cc:1261] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Refusing update from remote peer bb3bdf0773c34a0e9ec0ac9c37787fc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:10:11.875699 26094 consensus_queue.cc:1035] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:10:11.875885 26090 consensus_queue.cc:1035] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:10:11.879420 26100 mvcc.cc:205] Tried to move back new op lower bound from 7316164656638103552 to 7316164656496123904. Current Snapshot: MvccSnapshot[applied={T|T < 7316164656638103552}]
I20260808 07:10:11.879858 26099 mvcc.cc:205] Tried to move back new op lower bound from 7316164656638103552 to 7316164656496123904. Current Snapshot: MvccSnapshot[applied={T|T < 7316164656638103552}]
I20260808 07:10:11.881278 25579 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:10:11.881371 25579 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:10:11.882238 25579 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Sending DeleteTablet for 3 replicas of tablet e8f877c4b0b0498cae230d15ec43a607
I20260808 07:10:11.882547 25855 tablet_service.cc:1514] Processing DeleteTablet for tablet e8f877c4b0b0498cae230d15ec43a607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:10:11 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:33854
I20260808 07:10:11.882579 25996 tablet_service.cc:1514] Processing DeleteTablet for tablet e8f877c4b0b0498cae230d15ec43a607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:10:11 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:33464
I20260808 07:10:11.882664 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 25647
I20260808 07:10:11.883947 26107 tablet_replica.cc:330] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7: stopping tablet replica
I20260808 07:10:11.884058 26107 raft_consensus.cc:2229] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:10:11.884169 26107 raft_consensus.cc:2258] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:10:11.884327 26109 tablet_replica.cc:330] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb: stopping tablet replica
I20260808 07:10:11.884430 26109 raft_consensus.cc:2229] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:10:11.884528 26109 raft_consensus.cc:2258] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:10:11.885022 26109 ts_tablet_manager.cc:1905] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:10:11.885022 26107 ts_tablet_manager.cc:1905] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:10:11.886909 26109 ts_tablet_manager.cc:1918] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:10:11.886974 26107 ts_tablet_manager.cc:1918] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:10:11.887076 26107 log.cc:1196] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/e8f877c4b0b0498cae230d15ec43a607
I20260808 07:10:11.887076 26109 log.cc:1196] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/e8f877c4b0b0498cae230d15ec43a607
I20260808 07:10:11.887437 26107 ts_tablet_manager.cc:1939] T e8f877c4b0b0498cae230d15ec43a607 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Deleting consensus metadata
I20260808 07:10:11.887439 26109 ts_tablet_manager.cc:1939] T e8f877c4b0b0498cae230d15ec43a607 P 52028fb4ab3d4af1a2c6adc86989ceeb: Deleting consensus metadata
I20260808 07:10:11.887880 25566 catalog_manager.cc:4841] TS 52028fb4ab3d4af1a2c6adc86989ceeb (127.9.94.3:35741): tablet e8f877c4b0b0498cae230d15ec43a607 (table test-table [id=ed43aaa8abaf4805a28253e98d26bf5a]) successfully deleted
I20260808 07:10:11.887892 25564 catalog_manager.cc:4841] TS bb3bdf0773c34a0e9ec0ac9c37787fc7 (127.9.94.2:40329): tablet e8f877c4b0b0498cae230d15ec43a607 (table test-table [id=ed43aaa8abaf4805a28253e98d26bf5a]) successfully deleted
W20260808 07:10:11.893105 25566 connection.cc:535] client connection to 127.9.94.1:37021 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 07:10:11.893293 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 25788
W20260808 07:10:11.893335 25566 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 07:10:11.893715 25566 connection.cc:535] server connection from 127.9.94.1:59675 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 07:10:11.895238 26077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:11.895014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:37021 (local address 127.0.0.1:46582)
0808 07:10:11.895115 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:11.895187 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260808 07:10:11.895414 25566 catalog_manager.cc:4584] TS 9150e6c7223d488cb20f403aab311967 (127.9.94.1:37021): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e8f877c4b0b0498cae230d15ec43a607: Network error: Client connection negotiation failed: client connection to 127.9.94.1:37021: connect: Connection refused (error 111)
I20260808 07:10:11.902699 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 25930
I20260808 07:10:11.909404 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 25547
I20260808 07:10:31.918309 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:33957
--webserver_interface=127.9.94.62
--webserver_port=46031
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:33957
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:10:32.015870 26111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:32.016099 26111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:32.016124 26111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:32.017369 26111 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 07:10:32.017416 26111 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 07:10:32.017429 26111 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 07:10:32.017441 26111 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:10:32.017454 26111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:32.017467 26111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:32.017479 26111 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:10:32.017539 26111 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:10:32.019153 26111 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:33957
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:33957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=46031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26111
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:10:32.019433 26111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:32.019709 26111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:32.033234 26117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:32.033344 26111 server_base.cc:1034] running on GCE node
W20260808 07:10:32.033354 26118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:32.033166 26120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:32.034075 26111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:32.034468 26111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:32.035662 26111 hybrid_clock.cc:648] HybridClock initialized: now 1786173032035638 us; error 47 us; skew 500 ppm
Aug 08 07:10:32 dist-test-slave-77v9 krb5kdc[25534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173032, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:32.039033 26111 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:10:32.039619 26111 webserver.cc:460] Webserver started at http://127.9.94.62:46031/ using document root <none> and password file <none>
I20260808 07:10:32.039891 26111 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:32.039989 26111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:32.041638 26111 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:10:32.042652 26128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:32.042990 26111 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:10:32.043147 26111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "e3ccd52faf9f4480897152fe2297abe3"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "8cca70fe962e4af5bcc89735c3acf273"
server_key_iv: "c82f6208a9976c0dec6b3d15d14a37e9"
server_key_version: "encryptionkey@0"
I20260808 07:10:32.043645 26111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:32.057324 26111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:32.060595 26111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:32.060792 26111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:32.065829 26111 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:33957
I20260808 07:10:32.065917 26185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:33957 every 8 connection(s)
I20260808 07:10:32.066370 26111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:10:32.068244 26186 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:10:32.069067 26186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Bootstrap starting.
I20260808 07:10:32.076529 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 26111
I20260808 07:10:32.076974 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:37021
--local_ip_for_outbound_sockets=127.9.94.1
--tserver_master_addrs=127.9.94.62:33957
--webserver_port=40017
--webserver_interface=127.9.94.1
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:10:32.080242 26186 log.cc:824] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Log is configured to *not* fsync() on all Append() calls
I20260808 07:10:32.082861 26186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:10:32.083225 26186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Bootstrap complete.
I20260808 07:10:32.085901 26186 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } }
I20260808 07:10:32.086174 26186 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ccd52faf9f4480897152fe2297abe3, State: Initialized, Role: FOLLOWER
I20260808 07:10:32.086375 26186 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } }
I20260808 07:10:32.086483 26186 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:10:32.086571 26186 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:10:32.086627 26186 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:10:32.087767 26186 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } }
I20260808 07:10:32.087895 26186 leader_election.cc:302] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3ccd52faf9f4480897152fe2297abe3; no voters:
I20260808 07:10:32.088094 26186 leader_election.cc:288] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 07:10:32.088187 26190 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:10:32.088392 26186 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:10:32.088436 26190 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 2 LEADER]: Becoming Leader. State: Replica: e3ccd52faf9f4480897152fe2297abe3, State: Running, Role: LEADER
I20260808 07:10:32.088656 26190 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } }
I20260808 07:10:32.089025 26192 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e3ccd52faf9f4480897152fe2297abe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } } }
I20260808 07:10:32.089128 26192 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:10:32.089677 26193 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3ccd52faf9f4480897152fe2297abe3. Latest consensus state: current_term: 2 leader_uuid: "e3ccd52faf9f4480897152fe2297abe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } } }
I20260808 07:10:32.089751 26193 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:10:32.089936 26201 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:10:32.090961 26201 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:10:32.091074 26201 catalog_manager.cc:1259] Loaded cluster ID: 7b8a825bc800472495c72dad3cfbe8e7
I20260808 07:10:32.091110 26201 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:10:32.092296 26201 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:10:32.092484 26201 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Loaded TSK: 0
I20260808 07:10:32.109894 26201 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Generated new TSK 1
I20260808 07:10:32.110427 26201 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:10:32.178301 26188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:32.178552 26188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:32.178581 26188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:32.179987 26188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:32.180044 26188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:32.180076 26188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:10:32.181908 26188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:37021
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=40017
--tserver_master_addrs=127.9.94.62:33957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:10:32.182209 26188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:32.182471 26188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:32.188210 26219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:32.188180 26216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:32.188271 26215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:32.188434 26188 server_base.cc:1034] running on GCE node
I20260808 07:10:32.188849 26188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:32.189148 26188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:32.190325 26188 hybrid_clock.cc:648] HybridClock initialized: now 1786173032190301 us; error 39 us; skew 500 ppm
Aug 08 07:10:32 dist-test-slave-77v9 krb5kdc[25534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173032, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:32.193466 26188 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:10:32.194167 26188 webserver.cc:460] Webserver started at http://127.9.94.1:40017/ using document root <none> and password file <none>
I20260808 07:10:32.194581 26188 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:32.194711 26188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:32.196864 26188 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:10:32.197922 26226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:32.198429 26188 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:10:32.198558 26188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "9150e6c7223d488cb20f403aab311967"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "1df1e17014ad13166efd3824b3dd23e7"
server_key_iv: "2c4e9a31b98334648b4bd3aecc270d40"
server_key_version: "encryptionkey@0"
I20260808 07:10:32.199044 26188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:32.228952 26188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:32.232925 26188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:32.233121 26188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:32.233441 26188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:10:32.234109 26233 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 07:10:32.235888 26188 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 07:10:32.235958 26188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 07:10:32.235997 26188 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 07:10:32.236934 26188 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 07:10:32.237020 26188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.001s
I20260808 07:10:32.237057 26233 tablet_bootstrap.cc:492] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: Bootstrap starting.
I20260808 07:10:32.244777 26188 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:37021
I20260808 07:10:32.245463 26188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:10:32.245561 26348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:37021 every 8 connection(s)
I20260808 07:10:32.249330 26233 log.cc:824] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: Log is configured to *not* fsync() on all Append() calls
I20260808 07:10:32.252372 26233 tablet_bootstrap.cc:492] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:10:32.252755 26233 tablet_bootstrap.cc:492] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: Bootstrap complete.
I20260808 07:10:32.254057 26233 ts_tablet_manager.cc:1397] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.005s
Aug 08 07:10:32 dist-test-slave-77v9 krb5kdc[25534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173032, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:10:32.255795 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 26188
I20260808 07:10:32.255574 26233 raft_consensus.cc:348] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:32.255928 26233 raft_consensus.cc:729] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9150e6c7223d488cb20f403aab311967, State: Initialized, Role: FOLLOWER
I20260808 07:10:32.256076 26233 consensus_queue.cc:260] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:32.256420 26233 ts_tablet_manager.cc:1428] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:10:32.256451 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:40329
--local_ip_for_outbound_sockets=127.9.94.2
--tserver_master_addrs=127.9.94.62:33957
--webserver_port=35635
--webserver_interface=127.9.94.2
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:10:32.260370 26352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.246833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:43437 (local address 127.9.94.62:33957)
0808 07:10:32.248183 (+ 1350us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:32.248197 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:32.248249 (+ 52us) server_negotiation.cc:407] Connection header received
0808 07:10:32.248433 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:32.248443 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:32.248628 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:32.248803 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:32.249715 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.250889 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.252050 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.252447 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.253088 (+ 641us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.255065 (+ 1977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:32.255070 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:32.255070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:32.255088 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:32.257998 (+ 2910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:32.258662 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:32.258666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:32.258666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:32.258825 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:32.259136 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:32.259136 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:32.259137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:32.259474 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:32.259537 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:32.259950 (+ 413us) server_negotiation.cc:299] Negotiation successful
0808 07:10:32.260130 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1277,"thread_start_us":90,"threads_started":1}
I20260808 07:10:32.261122 26351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.246453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:43437)
0808 07:10:32.246690 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:32.246748 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:32.247818 (+ 1070us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:32.248892 (+ 1074us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:32.248897 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:32.249278 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:32.249565 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.249572 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.251037 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.251038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.251955 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.251958 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.252598 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.252599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.252728 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.253432 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:32.253440 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:32.254948 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:32.258140 (+ 3192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:32.258149 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:32.258151 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:32.258530 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:32.258917 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:32.258918 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:32.258918 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:32.259053 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:32.259591 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:32.259597 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:32.259752 (+ 155us) client_negotiation.cc:769] Sending connection context
0808 07:10:32.260669 (+ 917us) client_negotiation.cc:240] Negotiation successful
0808 07:10:32.260895 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":104,"threads_started":1}
I20260808 07:10:32.262012 26349 heartbeater.cc:347] Connected to a master server at 127.9.94.62:33957
I20260808 07:10:32.262147 26349 heartbeater.cc:464] Registering TS with master...
I20260808 07:10:32.262390 26349 heartbeater.cc:511] Master 127.9.94.62:33957 requested a full tablet report, sending...
I20260808 07:10:32.263314 26148 ts_manager.cc:194] Registered new tserver with Master: 9150e6c7223d488cb20f403aab311967 (127.9.94.1:37021)
I20260808 07:10:32.264671 26148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:43437
I20260808 07:10:32.265916 26349 heartbeater.cc:503] Master 127.9.94.62:33957 was elected leader, sending a full tablet report...
Aug 08 07:10:32 dist-test-slave-77v9 krb5kdc[25534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173032, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for kudu/127.9.94.1@KRBTEST.COM
I20260808 07:10:32.276257 26357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.264368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46690 (local address 127.9.94.1:37021)
0808 07:10:32.264933 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:32.264938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:32.264950 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:10:32.264994 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:32.264997 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:32.265018 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:32.265100 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:32.266957 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.268052 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.269505 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.269812 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.269890 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.272940 (+ 3050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:32.272951 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:32.272951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:32.272959 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:32.274771 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:32.275290 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:32.275293 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:32.275294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:32.275393 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:32.275640 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:32.275641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:32.275642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:32.275807 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:32.275888 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:32.276093 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 07:10:32.276183 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":102,"threads_started":1}
I20260808 07:10:32.276324 26356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.264066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:37021 (local address 127.0.0.1:46690)
0808 07:10:32.264582 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:32.264628 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:32.264714 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:32.265186 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:32.265195 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:32.266759 (+ 1564us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:32.266844 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.266848 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.268171 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.268173 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.269390 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.269393 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.269914 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.269919 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.270021 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.270755 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:32.270761 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:32.272785 (+ 2024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:32.274877 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:32.274887 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:32.274890 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:32.275197 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:32.275469 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:32.275470 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:32.275470 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:32.275546 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:32.275889 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:32.275896 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:32.275961 (+ 65us) client_negotiation.cc:769] Sending connection context
0808 07:10:32.276056 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 07:10:32.276203 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":100,"threads_started":1}
I20260808 07:10:32.276942 26279 tablet_service.cc:1514] Processing DeleteTablet for tablet e8f877c4b0b0498cae230d15ec43a607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:10:11 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:46690
I20260808 07:10:32.277537 26358 tablet_replica.cc:330] stopping tablet replica
I20260808 07:10:32.277679 26358 raft_consensus.cc:2229] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:10:32.277776 26358 raft_consensus.cc:2258] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:10:32.278201 26358 ts_tablet_manager.cc:1905] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:10:32.281306 26358 ts_tablet_manager.cc:1918] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:10:32.281405 26358 log.cc:1196] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal/wals/e8f877c4b0b0498cae230d15ec43a607
I20260808 07:10:32.281706 26358 ts_tablet_manager.cc:1939] T e8f877c4b0b0498cae230d15ec43a607 P 9150e6c7223d488cb20f403aab311967: Deleting consensus metadata
I20260808 07:10:32.283025 26132 catalog_manager.cc:4841] TS 9150e6c7223d488cb20f403aab311967 (127.9.94.1:37021): tablet e8f877c4b0b0498cae230d15ec43a607 (table test-table [id=ed43aaa8abaf4805a28253e98d26bf5a]) successfully deleted
W20260808 07:10:32.359637 26355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:32.359935 26355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:32.359990 26355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:32.361238 26355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:32.361317 26355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:32.361368 26355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:10:32.363011 26355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:40329
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=35635
--tserver_master_addrs=127.9.94.62:33957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:10:32.363353 26355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:32.363623 26355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:32.369249 26364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:32.369258 26366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:32.369267 26363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:32.369459 26355 server_base.cc:1034] running on GCE node
I20260808 07:10:32.369827 26355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:32.370111 26355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:32.371279 26355 hybrid_clock.cc:648] HybridClock initialized: now 1786173032371247 us; error 50 us; skew 500 ppm
Aug 08 07:10:32 dist-test-slave-77v9 krb5kdc[25534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173032, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:32.374747 26355 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:10:32.375300 26355 webserver.cc:460] Webserver started at http://127.9.94.2:35635/ using document root <none> and password file <none>
I20260808 07:10:32.375794 26355 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:32.375931 26355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:32.378271 26355 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 07:10:32.379225 26373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:32.379489 26355 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:10:32.379632 26355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "ae41a86becd97feef95a2838832efbcd"
server_key_iv: "345eb29c9d63d8ec8ffeff474e1d8240"
server_key_version: "encryptionkey@0"
I20260808 07:10:32.380053 26355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:32.398819 26355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:32.401445 26355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:32.401631 26355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:32.401904 26355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:10:32.402243 26355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:10:32.402300 26355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:32.402349 26355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:10:32.402381 26355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:32.410966 26355 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:40329
I20260808 07:10:32.411191 26496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:40329 every 8 connection(s)
I20260808 07:10:32.411518 26355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:10:32.414480 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 26355
I20260808 07:10:32.414875 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:35741
--local_ip_for_outbound_sockets=127.9.94.3
--tserver_master_addrs=127.9.94.62:33957
--webserver_port=40235
--webserver_interface=127.9.94.3
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:10:32 dist-test-slave-77v9 krb5kdc[25534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173032, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:10:32.422785 26352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.412472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:52325 (local address 127.9.94.62:33957)
0808 07:10:32.412544 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:32.412546 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:32.412715 (+ 169us) server_negotiation.cc:407] Connection header received
0808 07:10:32.413541 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:32.413542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:32.413554 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:32.413635 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:32.414710 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.415360 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.416386 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.416601 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.416691 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.419148 (+ 2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:32.419149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:32.419150 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:32.419157 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:32.420967 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:32.421474 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:32.421475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:32.421476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:32.421551 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:32.421846 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:32.421847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:32.421847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:32.422018 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:32.422110 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:32.422559 (+ 449us) server_negotiation.cc:299] Negotiation successful
0808 07:10:32.422674 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 07:10:32.423089 26499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.412424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:52325)
0808 07:10:32.412592 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:32.412637 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:32.413396 (+ 759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:32.413714 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:32.413717 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:32.414330 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:32.414595 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.414613 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.415459 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.415460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.416288 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.416290 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.416704 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.416705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.416904 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.417559 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:32.417568 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:32.419029 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:32.421082 (+ 2053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:32.421091 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:32.421094 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:32.421359 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:32.421640 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:32.421641 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:32.421641 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:32.421767 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:32.422114 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:32.422122 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:32.422368 (+ 246us) client_negotiation.cc:769] Sending connection context
0808 07:10:32.422535 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 07:10:32.422732 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":93,"threads_started":1}
I20260808 07:10:32.423681 26497 heartbeater.cc:347] Connected to a master server at 127.9.94.62:33957
I20260808 07:10:32.423779 26497 heartbeater.cc:464] Registering TS with master...
I20260808 07:10:32.424034 26497 heartbeater.cc:511] Master 127.9.94.62:33957 requested a full tablet report, sending...
I20260808 07:10:32.424561 26148 ts_manager.cc:194] Registered new tserver with Master: bb3bdf0773c34a0e9ec0ac9c37787fc7 (127.9.94.2:40329)
I20260808 07:10:32.425037 26148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:52325
W20260808 07:10:32.520234 26500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:32.520645 26500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:32.520699 26500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:32.523316 26500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:32.523568 26500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:32.523749 26500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:10:32.526635 26500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:35741
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=40235
--tserver_master_addrs=127.9.94.62:33957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:10:32.527007 26500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:32.527315 26500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:32.534206 26506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:32.534206 26508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:32.534432 26500 server_base.cc:1034] running on GCE node
W20260808 07:10:32.534206 26505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:32.534865 26500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:32.535219 26500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:32.536433 26500 hybrid_clock.cc:648] HybridClock initialized: now 1786173032536409 us; error 46 us; skew 500 ppm
Aug 08 07:10:32 dist-test-slave-77v9 krb5kdc[25534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173032, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:32.541129 26500 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:10:32.542141 26500 webserver.cc:460] Webserver started at http://127.9.94.3:40235/ using document root <none> and password file <none>
I20260808 07:10:32.542486 26500 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:32.542765 26500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:32.545192 26500 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:10:32.546144 26515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:32.546427 26500 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:10:32.546558 26500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "52028fb4ab3d4af1a2c6adc86989ceeb"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "43ea61e9728cd4c584e721694181af9d"
server_key_iv: "87dd54bc6d666b5798a607cd7698f406"
server_key_version: "encryptionkey@0"
I20260808 07:10:32.547341 26500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:32.580600 26500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:32.583412 26500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:32.583613 26500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:32.583906 26500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:10:32.584296 26500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:10:32.584360 26500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:32.584399 26500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:10:32.584419 26500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:32.591737 26500 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:35741
I20260808 07:10:32.591951 26635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:35741 every 8 connection(s)
I20260808 07:10:32.592234 26500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:10:32.593250 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 26500
Aug 08 07:10:32 dist-test-slave-77v9 krb5kdc[25534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173032, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:10:32.602458 26639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.593681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53208 (local address 127.9.94.62:33957)
0808 07:10:32.594041 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:32.594043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:32.594051 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:10:32.594080 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:32.594081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:32.594094 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:32.594166 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:32.595038 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.595735 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.596913 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.597266 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.597464 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.599177 (+ 1713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:32.599179 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:32.599179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:32.599187 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:32.600992 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:32.601381 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:32.601382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:32.601383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:32.601471 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:32.601712 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:32.601713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:32.601714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:32.601876 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:32.602023 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:32.602184 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 07:10:32.602314 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":82,"threads_started":1}
I20260808 07:10:32.604640 26352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.593217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:56429 (local address 127.9.94.62:33957)
0808 07:10:32.593302 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:32.593304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:32.593652 (+ 348us) server_negotiation.cc:407] Connection header received
0808 07:10:32.594396 (+ 744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:32.594397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:32.594407 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:32.594451 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:32.595582 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.596441 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.597948 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.598168 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.598264 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.600987 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:32.600989 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:32.600990 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:32.600997 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:32.603054 (+ 2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:32.603640 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:32.603641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:32.603641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:32.603697 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:32.603992 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:32.603992 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:32.603993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:32.604093 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:32.604143 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:32.604477 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 07:10:32.604575 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 07:10:32.604941 26638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.593199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:56429)
0808 07:10:32.593477 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:32.593527 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:32.594296 (+ 769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:32.594522 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:32.594526 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:32.595193 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:32.595468 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.595474 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.596574 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.596576 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.597823 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.597826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.598278 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.598279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.598422 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.598958 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:32.598966 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:32.600891 (+ 1925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:32.603155 (+ 2264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:32.603164 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:32.603167 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:32.603570 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:32.603802 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:32.603803 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:32.603803 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:32.603928 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:32.604138 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:32.604142 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:32.604308 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 07:10:32.604431 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 07:10:32.604613 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":116,"threads_started":1}
I20260808 07:10:32.605566 26636 heartbeater.cc:347] Connected to a master server at 127.9.94.62:33957
I20260808 07:10:32.605672 26636 heartbeater.cc:464] Registering TS with master...
I20260808 07:10:32.605823 26636 heartbeater.cc:511] Master 127.9.94.62:33957 requested a full tablet report, sending...
I20260808 07:10:32.606222 26148 ts_manager.cc:194] Registered new tserver with Master: 52028fb4ab3d4af1a2c6adc86989ceeb (127.9.94.3:35741)
I20260808 07:10:32.606570 26148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:56429
I20260808 07:10:32.615152 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:10:32.618717 26352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.615971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53222 (local address 127.9.94.62:33957)
0808 07:10:32.616043 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:32.616044 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:32.616051 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:10:32.616090 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:32.616090 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:32.616131 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:32.616220 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:10:32.616369 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.616915 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.617724 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.617922 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.618003 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.618169 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:10:32.618228 (+ 59us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 07:10:32.618519 (+ 291us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53222: token expired
Metrics: {"server-negotiator.queue_time_us":48}
W20260808 07:10:32.618813 26352 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53222: token expired
W20260808 07:10:32.619071 26069 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.9.94.62:33957)
I20260808 07:10:32.626161 26352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.619529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53226 (local address 127.9.94.62:33957)
0808 07:10:32.619595 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:32.619597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:32.619605 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:10:32.619627 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:32.619628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:32.619637 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:32.619689 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:32.620215 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.620690 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.621481 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.621682 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.621767 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.623073 (+ 1306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:32.623075 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:32.623075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:32.623083 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:32.624741 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:32.625281 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:32.625283 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:32.625283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:32.625348 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:32.625583 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:32.625584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:32.625584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:32.625713 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:32.625822 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:32.625967 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 07:10:32.626051 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 07:10:32.627889 26148 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53226:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:10:32.629750 26148 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:10:32.633118 26279 tablet_service.cc:1467] Processing CreateTablet for tablet c16cdd2a2cc54485b587d21821d45022 (DEFAULT_TABLE table=test-table [id=a2d253a6196546d29099ce37c8122091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:10:32.633427 26279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c16cdd2a2cc54485b587d21821d45022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:10:32.635062 26233 tablet_bootstrap.cc:492] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967: Bootstrap starting.
I20260808 07:10:32.635557 26233 tablet_bootstrap.cc:654] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967: Neither blocks nor log segments found. Creating new log.
I20260808 07:10:32.636148 26233 tablet_bootstrap.cc:492] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967: No bootstrap required, opened a new log
I20260808 07:10:32.636221 26233 ts_tablet_manager.cc:1397] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:10:32.637025 26233 raft_consensus.cc:348] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:32.637140 26233 raft_consensus.cc:374] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:10:32.637197 26233 raft_consensus.cc:729] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9150e6c7223d488cb20f403aab311967, State: Initialized, Role: FOLLOWER
I20260808 07:10:32.637255 26233 consensus_queue.cc:260] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:32.637367 26233 ts_tablet_manager.cc:1428] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 07:10:32.637440 26645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.632503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:40329 (local address 127.0.0.1:47368)
0808 07:10:32.632630 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:32.632648 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:32.632699 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:32.633186 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:32.633187 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:32.633189 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:10:32.633237 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.633239 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.634579 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.634580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.635797 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.635800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.637042 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.637044 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.637160 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.637192 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 07:10:32.637286 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 07:10:32.637345 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
I20260808 07:10:32.637710 26356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.632482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:35741 (local address 127.0.0.1:47436)
0808 07:10:32.632612 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:32.632625 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:32.632666 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:32.633055 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:32.633056 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:32.633059 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:10:32.633121 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.633123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.634415 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.634416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.635806 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.635808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.637429 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.637431 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.637519 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.637524 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:10:32.637588 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 07:10:32.637641 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109}
I20260808 07:10:32.637727 26646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.632591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47436 (local address 127.9.94.3:35741)
0808 07:10:32.632840 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:32.632846 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:32.632858 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:10:32.632907 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:32.632908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:32.632927 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:32.633026 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:10:32.633347 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.634307 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.635985 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.637208 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.637427 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.637501 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:32.637604 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 07:10:32.637644 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":201,"threads_started":1}
I20260808 07:10:32.637864 26648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.632790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47368 (local address 127.9.94.2:40329)
0808 07:10:32.632985 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:32.633012 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:32.633023 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:10:32.633064 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:32.633066 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:32.633081 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:32.633183 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:10:32.633347 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.634479 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.635919 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.636946 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.637044 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.637116 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:32.637591 (+ 475us) server_negotiation.cc:299] Negotiation successful
0808 07:10:32.637648 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":119,"threads_started":1}
I20260808 07:10:32.638746 26427 tablet_service.cc:1467] Processing CreateTablet for tablet c16cdd2a2cc54485b587d21821d45022 (DEFAULT_TABLE table=test-table [id=a2d253a6196546d29099ce37c8122091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:10:32.638861 26566 tablet_service.cc:1467] Processing CreateTablet for tablet c16cdd2a2cc54485b587d21821d45022 (DEFAULT_TABLE table=test-table [id=a2d253a6196546d29099ce37c8122091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:10:32.639151 26427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c16cdd2a2cc54485b587d21821d45022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:10:32.639228 26566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c16cdd2a2cc54485b587d21821d45022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:10:32.642266 26650 tablet_bootstrap.cc:492] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb: Bootstrap starting.
I20260808 07:10:32.642458 26651 tablet_bootstrap.cc:492] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Bootstrap starting.
I20260808 07:10:32.643087 26651 tablet_bootstrap.cc:654] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Neither blocks nor log segments found. Creating new log.
I20260808 07:10:32.643090 26650 tablet_bootstrap.cc:654] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb: Neither blocks nor log segments found. Creating new log.
I20260808 07:10:32.643708 26651 log.cc:824] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Log is configured to *not* fsync() on all Append() calls
I20260808 07:10:32.643715 26650 log.cc:824] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb: Log is configured to *not* fsync() on all Append() calls
I20260808 07:10:32.644482 26651 tablet_bootstrap.cc:492] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7: No bootstrap required, opened a new log
I20260808 07:10:32.644539 26651 ts_tablet_manager.cc:1397] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:10:32.644667 26650 tablet_bootstrap.cc:492] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb: No bootstrap required, opened a new log
I20260808 07:10:32.644757 26650 ts_tablet_manager.cc:1397] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:10:32.646566 26651 raft_consensus.cc:348] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:32.646744 26651 raft_consensus.cc:374] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:10:32.646770 26651 raft_consensus.cc:729] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb3bdf0773c34a0e9ec0ac9c37787fc7, State: Initialized, Role: FOLLOWER
I20260808 07:10:32.646679 26650 raft_consensus.cc:348] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:32.646878 26650 raft_consensus.cc:374] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:10:32.646926 26650 raft_consensus.cc:729] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52028fb4ab3d4af1a2c6adc86989ceeb, State: Initialized, Role: FOLLOWER
I20260808 07:10:32.646967 26651 consensus_queue.cc:260] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:32.647048 26650 consensus_queue.cc:260] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:32.647289 26651 ts_tablet_manager.cc:1428] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:10:32.647308 26497 heartbeater.cc:503] Master 127.9.94.62:33957 was elected leader, sending a full tablet report...
I20260808 07:10:32.647384 26650 ts_tablet_manager.cc:1428] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:10:32.647596 26636 heartbeater.cc:503] Master 127.9.94.62:33957 was elected leader, sending a full tablet report...
W20260808 07:10:32.662187 26498 tablet.cc:2369] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:10:32.746953 26350 tablet.cc:2369] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:10:32.757228 26655 raft_consensus.cc:482] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:10:32.757586 26655 raft_consensus.cc:504] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:32.758140 26655 leader_election.cc:288] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb3bdf0773c34a0e9ec0ac9c37787fc7 (127.9.94.2:40329), 9150e6c7223d488cb20f403aab311967 (127.9.94.1:37021)
I20260808 07:10:32.762727 26648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.758501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:56063 (local address 127.9.94.2:40329)
0808 07:10:32.758564 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:32.758566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:32.758588 (+ 22us) server_negotiation.cc:407] Connection header received
0808 07:10:32.758688 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:32.758689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:32.758704 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:32.758787 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:10:32.759104 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.759816 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.761541 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.762106 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.762203 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.762216 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:32.762573 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 07:10:32.762625 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:10:32.762741 26638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.758419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:40329 (local address 127.9.94.3:56063)
0808 07:10:32.758532 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:32.758549 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:32.758607 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:32.758807 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:32.758808 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:32.758810 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:10:32.758913 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.758916 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.759993 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.759994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.761410 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.761413 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.762278 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.762280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.762424 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.762432 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 07:10:32.762538 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 07:10:32.762610 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"mutex_wait_us":3}
I20260808 07:10:32.762883 26656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.758468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:37021 (local address 127.9.94.3:59515)
0808 07:10:32.758832 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:32.758844 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:32.758917 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:32.759404 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:32.759406 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:32.759410 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:10:32.759519 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.759522 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.760360 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.760361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.761672 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:32.761674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.762471 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.762472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:32.762553 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.762556 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:10:32.762706 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 07:10:32.762754 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":3,"thread_start_us":153,"threads_started":1}
I20260808 07:10:32.762919 26357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.758566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:59515 (local address 127.9.94.1:37021)
0808 07:10:32.758625 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:32.758627 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:32.758943 (+ 316us) server_negotiation.cc:407] Connection header received
0808 07:10:32.759104 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:32.759108 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:32.759151 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:32.759284 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:10:32.759632 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.760246 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.761775 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.762398 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.762463 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.762558 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:32.762725 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 07:10:32.762840 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:10:32.763247 26297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c16cdd2a2cc54485b587d21821d45022" candidate_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9150e6c7223d488cb20f403aab311967" is_pre_election: true
I20260808 07:10:32.763329 26448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c16cdd2a2cc54485b587d21821d45022" candidate_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" is_pre_election: true
I20260808 07:10:32.763450 26297 raft_consensus.cc:2454] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52028fb4ab3d4af1a2c6adc86989ceeb in term 0.
I20260808 07:10:32.763780 26519 leader_election.cc:302] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52028fb4ab3d4af1a2c6adc86989ceeb, 9150e6c7223d488cb20f403aab311967; no voters:
I20260808 07:10:32.763787 26448 raft_consensus.cc:2454] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52028fb4ab3d4af1a2c6adc86989ceeb in term 0.
I20260808 07:10:32.764073 26655 raft_consensus.cc:2781] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:10:32.764191 26655 raft_consensus.cc:482] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:10:32.764227 26655 raft_consensus.cc:3037] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:10:32.765161 26655 raft_consensus.cc:504] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:32.765368 26655 leader_election.cc:288] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [CANDIDATE]: Term 1 election: Requested vote from peers bb3bdf0773c34a0e9ec0ac9c37787fc7 (127.9.94.2:40329), 9150e6c7223d488cb20f403aab311967 (127.9.94.1:37021)
I20260808 07:10:32.765674 26448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c16cdd2a2cc54485b587d21821d45022" candidate_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7"
I20260808 07:10:32.765761 26297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c16cdd2a2cc54485b587d21821d45022" candidate_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9150e6c7223d488cb20f403aab311967"
I20260808 07:10:32.765815 26448 raft_consensus.cc:3037] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:10:32.765926 26297 raft_consensus.cc:3037] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:10:32.766795 26448 raft_consensus.cc:2454] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52028fb4ab3d4af1a2c6adc86989ceeb in term 1.
I20260808 07:10:32.767056 26517 leader_election.cc:302] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52028fb4ab3d4af1a2c6adc86989ceeb, bb3bdf0773c34a0e9ec0ac9c37787fc7; no voters:
I20260808 07:10:32.767189 26655 raft_consensus.cc:2781] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:10:32.767419 26655 raft_consensus.cc:686] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 1 LEADER]: Becoming Leader. State: Replica: 52028fb4ab3d4af1a2c6adc86989ceeb, State: Running, Role: LEADER
I20260808 07:10:32.767549 26655 consensus_queue.cc:237] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:32.767609 26297 raft_consensus.cc:2454] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52028fb4ab3d4af1a2c6adc86989ceeb in term 1.
I20260808 07:10:32.768939 26148 catalog_manager.cc:5495] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb reported cstate change: term changed from 0 to 1, leader changed from <none> to 52028fb4ab3d4af1a2c6adc86989ceeb (127.9.94.3). New cstate: current_term: 1 leader_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } health_report { overall_health: UNKNOWN } } }
I20260808 07:10:32.790169 26646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.786357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47446 (local address 127.9.94.3:35741)
0808 07:10:32.786420 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:32.786421 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:32.786501 (+ 80us) server_negotiation.cc:407] Connection header received
0808 07:10:32.786579 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:32.786580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:32.786604 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:32.786673 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:10:32.786945 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.787536 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.788619 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:32.788948 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:32.789030 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:32.789571 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:10:32.789760 (+ 189us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:10:32.789861 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:32.790048 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 07:10:32.790072 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:10:32.792804 26448 raft_consensus.cc:1261] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 1 FOLLOWER]: Refusing update from remote peer 52028fb4ab3d4af1a2c6adc86989ceeb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:10:32.792886 26297 raft_consensus.cc:1261] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Refusing update from remote peer 52028fb4ab3d4af1a2c6adc86989ceeb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:10:32.793278 26655 consensus_queue.cc:1035] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:10:32.793459 26658 consensus_queue.cc:1035] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:10:32.796772 26661 mvcc.cc:205] Tried to move back new op lower bound from 7316164742315233280 to 7316164742216941568. Current Snapshot: MvccSnapshot[applied={T|T < 7316164742315233280 or (T in {7316164742315233280})}]
I20260808 07:10:32.797732 26665 mvcc.cc:205] Tried to move back new op lower bound from 7316164742315233280 to 7316164742216941568. Current Snapshot: MvccSnapshot[applied={T|T < 7316164742315233280 or (T in {7316164742315233280})}]
I20260808 07:10:32.798056 26663 mvcc.cc:205] Tried to move back new op lower bound from 7316164742315233280 to 7316164742216941568. Current Snapshot: MvccSnapshot[applied={T|T < 7316164742315233280}]
I20260808 07:10:32.799522 26147 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53226:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:10:32.799624 26147 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53226:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:10:32.800560 26147 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Sending DeleteTablet for 3 replicas of tablet c16cdd2a2cc54485b587d21821d45022
I20260808 07:10:32.800980 26566 tablet_service.cc:1514] Processing DeleteTablet for tablet c16cdd2a2cc54485b587d21821d45022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:10:32 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:47436
I20260808 07:10:32.801031 26279 tablet_service.cc:1514] Processing DeleteTablet for tablet c16cdd2a2cc54485b587d21821d45022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:10:32 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:46690
I20260808 07:10:32.801101 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 26188
I20260808 07:10:32.802002 26427 tablet_service.cc:1514] Processing DeleteTablet for tablet c16cdd2a2cc54485b587d21821d45022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:10:32 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:47368
I20260808 07:10:32.802255 26672 tablet_replica.cc:330] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7: stopping tablet replica
I20260808 07:10:32.802382 26672 raft_consensus.cc:2229] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:10:32.802511 26672 raft_consensus.cc:2258] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:10:32.802700 26671 tablet_replica.cc:330] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb: stopping tablet replica
I20260808 07:10:32.802871 26671 raft_consensus.cc:2229] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:10:32.803030 26671 raft_consensus.cc:2258] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:10:32.803061 26672 ts_tablet_manager.cc:1905] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:10:32.803597 26671 ts_tablet_manager.cc:1905] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:10:32.805184 26672 ts_tablet_manager.cc:1918] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:10:32.805346 26672 log.cc:1196] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/c16cdd2a2cc54485b587d21821d45022
I20260808 07:10:32.805765 26672 ts_tablet_manager.cc:1939] T c16cdd2a2cc54485b587d21821d45022 P bb3bdf0773c34a0e9ec0ac9c37787fc7: Deleting consensus metadata
I20260808 07:10:32.806044 26671 ts_tablet_manager.cc:1918] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:10:32.806197 26671 log.cc:1196] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/c16cdd2a2cc54485b587d21821d45022
I20260808 07:10:32.806368 26130 catalog_manager.cc:4841] TS bb3bdf0773c34a0e9ec0ac9c37787fc7 (127.9.94.2:40329): tablet c16cdd2a2cc54485b587d21821d45022 (table test-table [id=a2d253a6196546d29099ce37c8122091]) successfully deleted
I20260808 07:10:32.806629 26671 ts_tablet_manager.cc:1939] T c16cdd2a2cc54485b587d21821d45022 P 52028fb4ab3d4af1a2c6adc86989ceeb: Deleting consensus metadata
I20260808 07:10:32.807085 26132 catalog_manager.cc:4841] TS 52028fb4ab3d4af1a2c6adc86989ceeb (127.9.94.3:35741): tablet c16cdd2a2cc54485b587d21821d45022 (table test-table [id=a2d253a6196546d29099ce37c8122091]) successfully deleted
W20260808 07:10:32.811028 26132 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:37021 (error 108)
I20260808 07:10:32.811401 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 26355
I20260808 07:10:32.812604 26356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:32.811603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:37021 (local address 127.0.0.1:46700)
0808 07:10:32.812497 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:32.812556 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":864}
W20260808 07:10:32.814312 26132 catalog_manager.cc:4584] TS 9150e6c7223d488cb20f403aab311967 (127.9.94.1:37021): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c16cdd2a2cc54485b587d21821d45022: Network error: Client connection negotiation failed: client connection to 127.9.94.1:37021: connect: Connection refused (error 111)
I20260808 07:10:32.823184 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 26500
I20260808 07:10:32.829509 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 26111
I20260808 07:10:52.837883 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:33957
--webserver_interface=127.9.94.62
--webserver_port=46031
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:33957
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:10:52.928229 26675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:52.928486 26675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:52.928514 26675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:52.929800 26675 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 07:10:52.929852 26675 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 07:10:52.929867 26675 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 07:10:52.929878 26675 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:10:52.929891 26675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:52.929905 26675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:52.929924 26675 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:10:52.929937 26675 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:10:52.931582 26675 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:33957
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:33957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=46031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:10:52.931877 26675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:52.932175 26675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:52.938827 26680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:52.938989 26675 server_base.cc:1034] running on GCE node
W20260808 07:10:52.939035 26681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:52.939493 26684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:52.940111 26675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:52.940534 26675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:52.941753 26675 hybrid_clock.cc:648] HybridClock initialized: now 1786173052941711 us; error 83 us; skew 500 ppm
Aug 08 07:10:52 dist-test-slave-77v9 krb5kdc[25534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173052, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:52.945079 26675 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:10:52.945698 26675 webserver.cc:460] Webserver started at http://127.9.94.62:46031/ using document root <none> and password file <none>
I20260808 07:10:52.945966 26675 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:52.946046 26675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:52.947621 26675 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:10:52.948503 26691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:52.948858 26675 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:10:52.948987 26675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "e3ccd52faf9f4480897152fe2297abe3"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "8cca70fe962e4af5bcc89735c3acf273"
server_key_iv: "c82f6208a9976c0dec6b3d15d14a37e9"
server_key_version: "encryptionkey@0"
I20260808 07:10:52.949410 26675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:52.966398 26675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:52.969311 26675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:52.969512 26675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:52.974545 26675 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:33957
I20260808 07:10:52.974589 26745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:33957 every 8 connection(s)
I20260808 07:10:52.975031 26675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:10:52.975637 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 26675
I20260808 07:10:52.976011 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:37021
--local_ip_for_outbound_sockets=127.9.94.1
--tserver_master_addrs=127.9.94.62:33957
--webserver_port=40017
--webserver_interface=127.9.94.1
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:10:52.977504 26746 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:10:52.978488 26746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Bootstrap starting.
I20260808 07:10:52.990314 26746 log.cc:824] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Log is configured to *not* fsync() on all Append() calls
I20260808 07:10:52.993630 26746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:10:52.994000 26746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Bootstrap complete.
I20260808 07:10:52.997434 26746 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } }
I20260808 07:10:52.997766 26746 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ccd52faf9f4480897152fe2297abe3, State: Initialized, Role: FOLLOWER
I20260808 07:10:52.997936 26746 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } }
I20260808 07:10:52.998005 26746 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:10:52.998045 26746 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:10:52.998093 26746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:10:52.999500 26746 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } }
I20260808 07:10:52.999614 26746 leader_election.cc:302] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3ccd52faf9f4480897152fe2297abe3; no voters:
I20260808 07:10:52.999806 26746 leader_election.cc:288] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 07:10:52.999904 26750 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 07:10:53.000119 26746 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:10:53.000130 26750 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [term 3 LEADER]: Becoming Leader. State: Replica: e3ccd52faf9f4480897152fe2297abe3, State: Running, Role: LEADER
I20260808 07:10:53.000346 26750 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } }
I20260808 07:10:53.000742 26751 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e3ccd52faf9f4480897152fe2297abe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } } }
I20260808 07:10:53.000852 26751 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:10:53.001168 26761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:10:53.001385 26753 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3ccd52faf9f4480897152fe2297abe3. Latest consensus state: current_term: 3 leader_uuid: "e3ccd52faf9f4480897152fe2297abe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ccd52faf9f4480897152fe2297abe3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 33957 } } }
I20260808 07:10:53.001457 26753 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:10:53.002269 26761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:10:53.002427 26761 catalog_manager.cc:1259] Loaded cluster ID: 7b8a825bc800472495c72dad3cfbe8e7
I20260808 07:10:53.002609 26761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:10:53.004017 26761 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:10:53.004215 26761 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Loaded TSK: 0
I20260808 07:10:53.004271 26761 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e3ccd52faf9f4480897152fe2297abe3: Loaded TSK: 1
F20260808 07:10:53.004522 26761 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fd91278c9ad google::LogMessage::Fail() at ??:0
@ 0x7fd91278f88a google::LogMessage::SendToLog() at ??:0
@ 0x7fd91278c4de google::LogMessage::Flush() at ??:0
@ 0x7fd91278da19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fd914ef9104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fd914ef6d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fd91a6e61cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fd91a6e648e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fd91a6e6594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fd91a6acc48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fd91a6b6ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fd91465a0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fd91464f954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fd9154b36db start_thread at ??:0
@ 0x7fd91128a61f clone at ??:0
W20260808 07:10:53.099956 26748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:53.100188 26748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:53.100215 26748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:53.101631 26748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:53.101683 26748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:53.101714 26748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:10:53.103375 26748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:37021
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=40017
--tserver_master_addrs=127.9.94.62:33957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:10:53.103648 26748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:53.103935 26748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:53.109622 26792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:53.109634 26791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:53.109655 26794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:53.110108 26748 server_base.cc:1034] running on GCE node
I20260808 07:10:53.110358 26748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:53.110627 26748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:53.111843 26748 hybrid_clock.cc:648] HybridClock initialized: now 1786173053111823 us; error 34 us; skew 500 ppm
Aug 08 07:10:53 dist-test-slave-77v9 krb5kdc[25534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173053, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:53.118587 26748 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:10:53.119192 26748 webserver.cc:460] Webserver started at http://127.9.94.1:40017/ using document root <none> and password file <none>
I20260808 07:10:53.119469 26748 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:53.119521 26748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:53.121762 26748 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:10:53.122725 26802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:53.122987 26748 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:10:53.123114 26748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "9150e6c7223d488cb20f403aab311967"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "1df1e17014ad13166efd3824b3dd23e7"
server_key_iv: "2c4e9a31b98334648b4bd3aecc270d40"
server_key_version: "encryptionkey@0"
I20260808 07:10:53.123548 26748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:53.141222 26748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:53.144042 26748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:53.144240 26748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:53.144524 26748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:10:53.145166 26809 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 07:10:53.147506 26748 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 07:10:53.147595 26748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260808 07:10:53.147648 26748 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 07:10:53.148427 26748 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 07:10:53.148490 26748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 07:10:53.148569 26809 tablet_bootstrap.cc:492] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967: Bootstrap starting.
I20260808 07:10:53.156586 26748 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:37021
I20260808 07:10:53.156737 26922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:37021 every 8 connection(s)
I20260808 07:10:53.157087 26748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:10:53.161352 26809 log.cc:824] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967: Log is configured to *not* fsync() on all Append() calls
I20260808 07:10:53.164634 26809 tablet_bootstrap.cc:492] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:10:53.165097 26809 tablet_bootstrap.cc:492] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967: Bootstrap complete.
I20260808 07:10:53.166056 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 26748
I20260808 07:10:53.166458 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:40329
--local_ip_for_outbound_sockets=127.9.94.2
--tserver_master_addrs=127.9.94.62:33957
--webserver_port=35635
--webserver_interface=127.9.94.2
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:10:53.166508 26809 ts_tablet_manager.cc:1397] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.011s
I20260808 07:10:53.168262 26809 raft_consensus.cc:348] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:53.168643 26809 raft_consensus.cc:729] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9150e6c7223d488cb20f403aab311967, State: Initialized, Role: FOLLOWER
I20260808 07:10:53.168875 26809 consensus_queue.cc:260] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:53.169205 26809 ts_tablet_manager.cc:1428] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
W20260808 07:10:53.237437 26925 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:53.157967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:35157)
0808 07:10:53.158222 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:53.158296 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:53.158768 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:53.237065 (+ 78297us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":138,"threads_started":1}
W20260808 07:10:53.237739 26923 heartbeater.cc:644] Failed to heartbeat to 127.9.94.62:33957 (0 consecutive failures): Network error: Failed to ping master at 127.9.94.62:33957: Client connection negotiation failed: client connection to 127.9.94.62:33957: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 07:10:53.238235 26925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:53.238098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:46741)
0808 07:10:53.238161 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:53.238212 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 07:10:53.238615 26925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:53.238549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:44065)
0808 07:10:53.238577 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:53.238599 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260808 07:10:53.238744 26923 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:10:53.259130 26927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:53.259379 26927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:53.259408 26927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:53.260639 26927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:53.260679 26927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:53.260706 26927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:10:53.262261 26927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:40329
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=35635
--tserver_master_addrs=127.9.94.62:33957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:10:53.262472 26927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:53.262668 26927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:53.268318 26933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:53.268276 26936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:53.268373 26927 server_base.cc:1034] running on GCE node
W20260808 07:10:53.268306 26934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:53.268765 26927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:53.269100 26927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:53.270285 26927 hybrid_clock.cc:648] HybridClock initialized: now 1786173053270260 us; error 36 us; skew 500 ppm
Aug 08 07:10:53 dist-test-slave-77v9 krb5kdc[25534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173053, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:53.273032 26927 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:10:53.273589 26927 webserver.cc:460] Webserver started at http://127.9.94.2:35635/ using document root <none> and password file <none>
I20260808 07:10:53.273824 26927 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:53.273870 26927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:53.275352 26927 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:10:53.276114 26944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:53.276384 26927 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:10:53.276495 26927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "ae41a86becd97feef95a2838832efbcd"
server_key_iv: "345eb29c9d63d8ec8ffeff474e1d8240"
server_key_version: "encryptionkey@0"
I20260808 07:10:53.277060 26927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:53.310307 26927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:53.313405 26927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:53.313614 26927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:53.313980 26927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:10:53.314378 26927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:10:53.314447 26927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:53.314488 26927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:10:53.314528 26927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:53.321481 26927 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:40329
I20260808 07:10:53.321547 27063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:40329 every 8 connection(s)
I20260808 07:10:53.321933 26927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:10:53.323191 27066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:53.322686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:46073)
0808 07:10:53.322953 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:53.323043 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":80,"threads_started":1}
W20260808 07:10:53.323715 27064 heartbeater.cc:644] Failed to heartbeat to 127.9.94.62:33957 (0 consecutive failures): Network error: Failed to ping master at 127.9.94.62:33957: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
I20260808 07:10:53.324072 27066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:53.323965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:54135)
0808 07:10:53.324024 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:53.324053 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 07:10:53.324438 27066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:53.324348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:59143)
0808 07:10:53.324394 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:53.324421 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 07:10:53.324441 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 26927
W20260808 07:10:53.324558 27064 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 07:10:53.324867 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:35741
--local_ip_for_outbound_sockets=127.9.94.3
--tserver_master_addrs=127.9.94.62:33957
--webserver_port=40235
--webserver_interface=127.9.94.3
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:10:53.418373 27067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:53.418591 27067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:53.418617 27067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:53.419710 27067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:53.419749 27067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:53.419776 27067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:10:53.421316 27067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:35741
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=40235
--tserver_master_addrs=127.9.94.62:33957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:10:53.421519 27067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:53.421705 27067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:53.428165 27072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:53.428162 27073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:53.428280 27076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:53.428542 27067 server_base.cc:1034] running on GCE node
I20260808 07:10:53.428782 27067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:53.429121 27067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:53.430258 27067 hybrid_clock.cc:648] HybridClock initialized: now 1786173053430235 us; error 41 us; skew 500 ppm
Aug 08 07:10:53 dist-test-slave-77v9 krb5kdc[25534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173053, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:53.434418 27067 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:10:53.435097 27067 webserver.cc:460] Webserver started at http://127.9.94.3:40235/ using document root <none> and password file <none>
I20260808 07:10:53.435426 27067 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:53.435490 27067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:53.437553 27067 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:10:53.438390 27084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:53.438651 27067 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:10:53.438768 27067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "52028fb4ab3d4af1a2c6adc86989ceeb"
format_stamp: "Formatted at 2026-08-08 07:10:11 on dist-test-slave-77v9"
server_key: "43ea61e9728cd4c584e721694181af9d"
server_key_iv: "87dd54bc6d666b5798a607cd7698f406"
server_key_version: "encryptionkey@0"
I20260808 07:10:53.439164 27067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:53.447762 27067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:53.449988 27067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:53.450176 27067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:53.450429 27067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:10:53.450765 27067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:10:53.450830 27067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:53.450876 27067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:10:53.450906 27067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:53.457541 27067 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:35741
I20260808 07:10:53.457587 27202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:35741 every 8 connection(s)
I20260808 07:10:53.457978 27067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:10:53.459184 27205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:53.458675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:49011)
0808 07:10:53.458914 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:53.459022 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":73,"threads_started":1}
W20260808 07:10:53.459700 27203 heartbeater.cc:644] Failed to heartbeat to 127.9.94.62:33957 (0 consecutive failures): Network error: Failed to ping master at 127.9.94.62:33957: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
I20260808 07:10:53.460284 27205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:53.459974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:55051)
0808 07:10:53.460141 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:53.460233 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260808 07:10:53.460971 27205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:53.460737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:52101)
0808 07:10:53.460901 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:53.460941 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 07:10:53.461154 27203 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 07:10:53.461931 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 27067
I20260808 07:10:54.239419 27207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:54.239140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:58157)
0808 07:10:54.239307 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:54.239355 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":69,"threads_started":1}
I20260808 07:10:54.325363 27208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:54.325145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:55969)
0808 07:10:54.325269 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:54.325305 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260808 07:10:54.462013 27209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:54.461590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:38329)
0808 07:10:54.461828 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:54.461910 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":67,"threads_started":1}
I20260808 07:10:54.993187 27210 raft_consensus.cc:482] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:10:54.993371 27210 raft_consensus.cc:504] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:54.993829 27210 leader_election.cc:288] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 52028fb4ab3d4af1a2c6adc86989ceeb (127.9.94.3:35741), bb3bdf0773c34a0e9ec0ac9c37787fc7 (127.9.94.2:40329)
Aug 08 07:10:55 dist-test-slave-77v9 krb5kdc[25534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173053, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.3@KRBTEST.COM
Aug 08 07:10:55 dist-test-slave-77v9 krb5kdc[25534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173053, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.2@KRBTEST.COM
I20260808 07:10:55.006680 27213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:54.994245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:51173 (local address 127.9.94.2:40329)
0808 07:10:54.994448 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:54.994458 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:54.994483 (+ 25us) server_negotiation.cc:407] Connection header received
0808 07:10:54.995058 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:54.995060 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:54.995106 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:54.995262 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:54.996176 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:54.997190 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:54.998139 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:54.998587 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:54.998720 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:55.002240 (+ 3520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:55.002244 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:55.002244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:55.002255 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:55.004453 (+ 2198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:55.005042 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:55.005045 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:55.005046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:55.005166 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:55.005478 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:55.005479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:55.005480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:55.005786 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:55.005900 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:55.006364 (+ 464us) server_negotiation.cc:299] Negotiation successful
0808 07:10:55.006535 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":62,"threads_started":1}
I20260808 07:10:55.006680 27211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:54.994080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:35741 (local address 127.9.94.1:40211)
0808 07:10:54.994214 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:54.994225 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:54.994287 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:54.995358 (+ 1071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:54.995360 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:54.995755 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:54.996002 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:54.996009 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:54.997241 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:54.997243 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:54.998031 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:54.998034 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:54.998642 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:54.998643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:54.998771 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:54.999440 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:54.999445 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:55.001673 (+ 2228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:55.004179 (+ 2506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:55.004188 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:55.004191 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:55.004562 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:55.005017 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:55.005018 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:55.005018 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:55.005210 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:55.005816 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:55.005851 (+ 35us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:55.006046 (+ 195us) client_negotiation.cc:769] Sending connection context
0808 07:10:55.006206 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 07:10:55.006548 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":243,"thread_start_us":89,"threads_started":1}
I20260808 07:10:55.006680 27212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:54.994080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:40329 (local address 127.9.94.1:51173)
0808 07:10:54.994211 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:54.994225 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:54.994287 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:54.995304 (+ 1017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:54.995307 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:54.995754 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:54.996009 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:54.996012 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:54.997320 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:54.997321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:54.998032 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:54.998034 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:54.998684 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:54.998685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:54.998771 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:54.999388 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:54.999397 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:55.002107 (+ 2710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:55.004572 (+ 2465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:55.004573 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:55.004573 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:55.004890 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:55.005263 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:55.005264 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:55.005265 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:55.005348 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:55.005869 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:55.005870 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:55.006046 (+ 176us) client_negotiation.cc:769] Sending connection context
0808 07:10:55.006206 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 07:10:55.006480 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":71,"thread_start_us":52,"threads_started":1}
I20260808 07:10:55.006680 27214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:54.994245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:40211 (local address 127.9.94.3:35741)
0808 07:10:54.994445 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:54.994456 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:54.994503 (+ 47us) server_negotiation.cc:407] Connection header received
0808 07:10:54.995162 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:54.995165 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:54.995208 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:54.995372 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:54.996149 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:54.997133 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:54.998141 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:54.998548 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:54.998678 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:55.001886 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:55.001892 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:55.001892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:55.001908 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:55.004084 (+ 2176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:55.004669 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:55.004674 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:55.004674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:55.004858 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:55.005306 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:55.005308 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:55.005308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:55.005707 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:55.005825 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:55.006351 (+ 526us) server_negotiation.cc:299] Negotiation successful
0808 07:10:55.006535 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":58,"threads_started":1}
W20260808 07:10:55.007717 26806 leader_election.cc:341] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 52028fb4ab3d4af1a2c6adc86989ceeb (127.9.94.3:35741): Not found: Tablet not found: c16cdd2a2cc54485b587d21821d45022
W20260808 07:10:55.008008 26804 leader_election.cc:341] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bb3bdf0773c34a0e9ec0ac9c37787fc7 (127.9.94.2:40329): Not found: Tablet not found: c16cdd2a2cc54485b587d21821d45022
I20260808 07:10:55.008071 26804 leader_election.cc:302] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9150e6c7223d488cb20f403aab311967; no voters: 52028fb4ab3d4af1a2c6adc86989ceeb, bb3bdf0773c34a0e9ec0ac9c37787fc7
I20260808 07:10:55.008209 27210 raft_consensus.cc:2726] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:10:55.240270 27211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:55.240086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:36593)
0808 07:10:55.240184 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:55.240227 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 07:10:55.326243 27215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:55.325929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:43703)
0808 07:10:55.326100 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:55.326157 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":84,"threads_started":1}
I20260808 07:10:55.463227 27216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:55.462902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:49813)
0808 07:10:55.463095 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:55.463169 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":95,"threads_started":1}
I20260808 07:10:56.241315 27217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:56.241050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:45189)
0808 07:10:56.241219 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:56.241260 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":108,"threads_started":1}
I20260808 07:10:56.327132 27218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:56.326884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:38467)
0808 07:10:56.327038 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:56.327082 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":79,"threads_started":1}
I20260808 07:10:56.464284 27219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:56.463914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:43999)
0808 07:10:56.464169 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:56.464214 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":95,"threads_started":1}
I20260808 07:10:57.184414 27220 raft_consensus.cc:482] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:10:57.184528 27220 raft_consensus.cc:504] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:10:57.184772 27220 leader_election.cc:288] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 52028fb4ab3d4af1a2c6adc86989ceeb (127.9.94.3:35741), bb3bdf0773c34a0e9ec0ac9c37787fc7 (127.9.94.2:40329)
W20260808 07:10:57.185423 26806 leader_election.cc:341] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 52028fb4ab3d4af1a2c6adc86989ceeb (127.9.94.3:35741): Not found: Tablet not found: c16cdd2a2cc54485b587d21821d45022
W20260808 07:10:57.185491 26804 leader_election.cc:341] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bb3bdf0773c34a0e9ec0ac9c37787fc7 (127.9.94.2:40329): Not found: Tablet not found: c16cdd2a2cc54485b587d21821d45022
I20260808 07:10:57.185521 26806 leader_election.cc:302] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9150e6c7223d488cb20f403aab311967; no voters: 52028fb4ab3d4af1a2c6adc86989ceeb, bb3bdf0773c34a0e9ec0ac9c37787fc7
I20260808 07:10:57.185607 27220 raft_consensus.cc:2726] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:10:57.242307 27221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:57.242029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:33159)
0808 07:10:57.242195 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:57.242250 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":73,"threads_started":1}
I20260808 07:10:57.328034 27222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:57.327670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:57745)
0808 07:10:57.327934 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:57.327973 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":204,"threads_started":1}
I20260808 07:10:57.465394 27223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:57.464985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:33933)
0808 07:10:57.465244 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:57.465323 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":94,"threads_started":1}
I20260808 07:10:58.243396 27224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:58.243117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:34989)
0808 07:10:58.243308 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:58.243347 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":123,"threads_started":1}
I20260808 07:10:58.329083 27225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:58.328778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:47183)
0808 07:10:58.328996 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:58.329033 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":128,"threads_started":1}
I20260808 07:10:58.466639 27226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:58.466313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:36855)
0808 07:10:58.466537 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:58.466587 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":107,"threads_started":1}
I20260808 07:10:59.244282 27227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:59.244030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:58681)
0808 07:10:59.244190 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:59.244233 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":72,"threads_started":1}
I20260808 07:10:59.329885 27228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:59.329645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:59641)
0808 07:10:59.329789 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:59.329828 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":67,"threads_started":1}
I20260808 07:10:59.467953 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:59.467631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:35795)
0808 07:10:59.467832 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:59.467883 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":86,"threads_started":1}
I20260808 07:11:00.202644 27230 raft_consensus.cc:482] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:11:00.202807 27230 raft_consensus.cc:504] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:11:00.203054 27230 leader_election.cc:288] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 52028fb4ab3d4af1a2c6adc86989ceeb (127.9.94.3:35741), bb3bdf0773c34a0e9ec0ac9c37787fc7 (127.9.94.2:40329)
W20260808 07:11:00.203576 26804 leader_election.cc:341] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bb3bdf0773c34a0e9ec0ac9c37787fc7 (127.9.94.2:40329): Not found: Tablet not found: c16cdd2a2cc54485b587d21821d45022
W20260808 07:11:00.203661 26806 leader_election.cc:341] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 52028fb4ab3d4af1a2c6adc86989ceeb (127.9.94.3:35741): Not found: Tablet not found: c16cdd2a2cc54485b587d21821d45022
I20260808 07:11:00.203711 26806 leader_election.cc:302] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9150e6c7223d488cb20f403aab311967; no voters: 52028fb4ab3d4af1a2c6adc86989ceeb, bb3bdf0773c34a0e9ec0ac9c37787fc7
I20260808 07:11:00.203817 27230 raft_consensus.cc:2726] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:11:00.245353 27232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:00.245033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:54361)
0808 07:11:00.245257 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:00.245301 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":113,"threads_started":1}
I20260808 07:11:00.330762 27233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:00.330458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:43987)
0808 07:11:00.330665 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:00.330705 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":88,"threads_started":1}
I20260808 07:11:00.469081 27234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:00.468532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:55943)
0808 07:11:00.468769 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:00.469009 (+ 240us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":116,"threads_started":1}
I20260808 07:11:01.246381 27235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:01.246079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:59953)
0808 07:11:01.246271 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:01.246327 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":93,"threads_started":1}
I20260808 07:11:01.331745 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:01.331441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:44425)
0808 07:11:01.331641 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:01.331690 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":104,"threads_started":1}
I20260808 07:11:01.469811 27237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:01.469553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:34181)
0808 07:11:01.469691 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:01.469734 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":76,"threads_started":1}
I20260808 07:11:02.247493 27238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:02.247244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:55187)
0808 07:11:02.247392 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:02.247432 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":72,"threads_started":1}
I20260808 07:11:02.332773 27239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:02.332519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:57241)
0808 07:11:02.332667 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:02.332714 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":92,"threads_started":1}
I20260808 07:11:02.470755 27240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:02.470491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:56015)
0808 07:11:02.470655 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:02.470703 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":74,"threads_started":1}
I20260808 07:11:03.249082 27243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:03.248458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:59479)
0808 07:11:03.248725 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:03.248788 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":166,"threads_started":1}
I20260808 07:11:03.334043 27244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:03.333631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:57609)
0808 07:11:03.333906 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:03.333977 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":128,"threads_started":1}
I20260808 07:11:03.471661 27245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:03.471352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:51917)
0808 07:11:03.471549 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:03.471607 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":84,"threads_started":1}
I20260808 07:11:04.250147 27246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:04.249835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:35579)
0808 07:11:04.250047 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:04.250095 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":86,"threads_started":1}
I20260808 07:11:04.335107 27247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:04.334758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:55703)
0808 07:11:04.335010 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:04.335054 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":144,"threads_started":1}
I20260808 07:11:04.472718 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:04.472368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:45079)
0808 07:11:04.472616 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:04.472664 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":73,"threads_started":1}
I20260808 07:11:04.950626 27249 raft_consensus.cc:482] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:11:04.950745 27249 raft_consensus.cc:504] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52028fb4ab3d4af1a2c6adc86989ceeb" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 35741 } } peers { permanent_uuid: "bb3bdf0773c34a0e9ec0ac9c37787fc7" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 40329 } } peers { permanent_uuid: "9150e6c7223d488cb20f403aab311967" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 37021 } }
I20260808 07:11:04.951036 27249 leader_election.cc:288] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 52028fb4ab3d4af1a2c6adc86989ceeb (127.9.94.3:35741), bb3bdf0773c34a0e9ec0ac9c37787fc7 (127.9.94.2:40329)
W20260808 07:11:04.951495 26804 leader_election.cc:341] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bb3bdf0773c34a0e9ec0ac9c37787fc7 (127.9.94.2:40329): Not found: Tablet not found: c16cdd2a2cc54485b587d21821d45022
W20260808 07:11:04.951579 26806 leader_election.cc:341] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 52028fb4ab3d4af1a2c6adc86989ceeb (127.9.94.3:35741): Not found: Tablet not found: c16cdd2a2cc54485b587d21821d45022
I20260808 07:11:04.951671 26806 leader_election.cc:302] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9150e6c7223d488cb20f403aab311967; no voters: 52028fb4ab3d4af1a2c6adc86989ceeb, bb3bdf0773c34a0e9ec0ac9c37787fc7
I20260808 07:11:04.951736 27249 raft_consensus.cc:2726] T c16cdd2a2cc54485b587d21821d45022 P 9150e6c7223d488cb20f403aab311967 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:11:05.251121 27250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:05.250791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:55731)
0808 07:11:05.251025 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:05.251071 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":132,"threads_started":1}
I20260808 07:11:05.336149 27251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:05.335851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:59349)
0808 07:11:05.336047 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:05.336096 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":111,"threads_started":1}
I20260808 07:11:05.473814 27252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:05.473533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:55545)
0808 07:11:05.473707 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:05.473755 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":92,"threads_started":1}
I20260808 07:11:06.252130 27253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:06.251843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:57393)
0808 07:11:06.252032 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:06.252076 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":96,"threads_started":1}
I20260808 07:11:06.337145 27254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:06.336906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:55399)
0808 07:11:06.337047 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:06.337093 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":87,"threads_started":1}
I20260808 07:11:06.474994 27255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:06.474646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:51413)
0808 07:11:06.474888 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:06.474941 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":75,"threads_started":1}
I20260808 07:11:07.253224 27256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:07.252913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:54113)
0808 07:11:07.253113 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:07.253168 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":71,"threads_started":1}
I20260808 07:11:07.338120 27257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:07.337763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:34951)
0808 07:11:07.337989 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:07.338038 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":88,"threads_started":1}
I20260808 07:11:07.476302 27258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:07.475903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:59549)
0808 07:11:07.476172 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:07.476247 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":102,"threads_started":1}
I20260808 07:11:08.254308 27259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:08.254058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.1:43227)
0808 07:11:08.254211 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:08.254257 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":67,"threads_started":1}
I20260808 07:11:08.339180 27260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:08.338911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.2:35485)
0808 07:11:08.339075 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:08.339122 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":75,"threads_started":1}
I20260808 07:11:08.473269 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 26748
I20260808 07:11:08.479548 27261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:08.477025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:33957 (local address 127.9.94.3:43181)
0808 07:11:08.479300 (+ 2275us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:08.479470 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.62:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2248,"thread_start_us":126,"threads_started":1}
I20260808 07:11:08.484058 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 26927
I20260808 07:11:08.490062 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 27067
2026-08-08T07:11:08Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58863 ms)
[----------] 30 tests from SecurityITest (254667 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:08 dist-test-slave-77v9 krb5kdc[27264](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:08 dist-test-slave-77v9 krb5kdc[27264](info): set up 2 sockets
Aug 08 07:11:08 dist-test-slave-77v9 krb5kdc[27264](info): commencing operation
krb5kdc: starting...
W20260808 07:11:09.667995 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:09 dist-test-slave-77v9 krb5kdc[27264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:11:09.813218 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:34557
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:34557
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:09.911342 27279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:09.911695 27279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:09.911764 27279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:09.913194 27279 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:09.913247 27279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:09.913264 27279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:09.913280 27279 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:09.913293 27279 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:09.915174 27279 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:34557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:34557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27279
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:09.915424 27279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:09.915624 27279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:09.921207 27287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:09.921394 27284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:09.921432 27285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:09.921619 27279 server_base.cc:1034] running on GCE node
I20260808 07:11:09.921926 27279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:09.922236 27279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:09.923617 27279 hybrid_clock.cc:648] HybridClock initialized: now 1786173069923616 us; error 66 us; skew 500 ppm
Aug 08 07:11:09 dist-test-slave-77v9 krb5kdc[27264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173069, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:09.927950 27279 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:11:09.928572 27279 webserver.cc:460] Webserver started at http://127.9.94.62:35909/ using document root <none> and password file <none>
I20260808 07:11:09.928941 27279 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:09.929024 27279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:09.929214 27279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:09.930538 27279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "501e9f004d204071bfe4b932b558e1ab"
format_stamp: "Formatted at 2026-08-08 07:11:09 on dist-test-slave-77v9"
server_key: "49cfcfd4956bb925fb347dbf0bddebca"
server_key_iv: "48d5871d295686934898c29e88a173c9"
server_key_version: "encryptionkey@0"
I20260808 07:11:09.930979 27279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "501e9f004d204071bfe4b932b558e1ab"
format_stamp: "Formatted at 2026-08-08 07:11:09 on dist-test-slave-77v9"
server_key: "49cfcfd4956bb925fb347dbf0bddebca"
server_key_iv: "48d5871d295686934898c29e88a173c9"
server_key_version: "encryptionkey@0"
I20260808 07:11:09.933095 27279 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260808 07:11:09.934363 27294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:09.934677 27279 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:09.934808 27279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "501e9f004d204071bfe4b932b558e1ab"
format_stamp: "Formatted at 2026-08-08 07:11:09 on dist-test-slave-77v9"
server_key: "49cfcfd4956bb925fb347dbf0bddebca"
server_key_iv: "48d5871d295686934898c29e88a173c9"
server_key_version: "encryptionkey@0"
I20260808 07:11:09.934932 27279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:09.953553 27279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:09.956156 27279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:09.956331 27279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:09.961185 27279 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:34557
I20260808 07:11:09.961253 27348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:34557 every 8 connection(s)
I20260808 07:11:09.961630 27279 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:09.962553 27349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:09.964998 27349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab: Bootstrap starting.
I20260808 07:11:09.965600 27349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:09.965849 27349 log.cc:824] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:09.966943 27349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab: No bootstrap required, opened a new log
I20260808 07:11:09.969169 27349 raft_consensus.cc:348] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "501e9f004d204071bfe4b932b558e1ab" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34557 } }
I20260808 07:11:09.969332 27349 raft_consensus.cc:374] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:09.969355 27349 raft_consensus.cc:729] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501e9f004d204071bfe4b932b558e1ab, State: Initialized, Role: FOLLOWER
I20260808 07:11:09.969864 27349 consensus_queue.cc:260] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "501e9f004d204071bfe4b932b558e1ab" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34557 } }
I20260808 07:11:09.970047 27349 raft_consensus.cc:388] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:09.970082 27349 raft_consensus.cc:482] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:09.970129 27349 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:09.970646 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 27279
I20260808 07:11:09.970798 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:09.971161 9592 external_mini_cluster.cc:1428] Setting key 63e5e5febf41930fd11e579521f7c1e0
I20260808 07:11:09.971436 27349 raft_consensus.cc:504] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "501e9f004d204071bfe4b932b558e1ab" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34557 } }
I20260808 07:11:09.971711 27349 leader_election.cc:302] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 501e9f004d204071bfe4b932b558e1ab; no voters:
I20260808 07:11:09.972174 27349 leader_election.cc:288] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:09.972229 27354 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:09.972491 27354 raft_consensus.cc:686] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [term 1 LEADER]: Becoming Leader. State: Replica: 501e9f004d204071bfe4b932b558e1ab, State: Running, Role: LEADER
I20260808 07:11:09.972671 27349 sys_catalog.cc:564] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:09.972713 27354 consensus_queue.cc:237] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "501e9f004d204071bfe4b932b558e1ab" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34557 } }
I20260808 07:11:09.973423 27356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 501e9f004d204071bfe4b932b558e1ab. Latest consensus state: current_term: 1 leader_uuid: "501e9f004d204071bfe4b932b558e1ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "501e9f004d204071bfe4b932b558e1ab" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34557 } } }
I20260808 07:11:09.973649 27356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:09.973594 27355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "501e9f004d204071bfe4b932b558e1ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "501e9f004d204071bfe4b932b558e1ab" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34557 } } }
I20260808 07:11:09.973798 27355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab [sys.catalog]: This master's current role is: LEADER
W20260808 07:11:09.975168 27369 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:11:09.975294 27369 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:11:09.975837 27363 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:09.976087 27363 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 07:11:09 dist-test-slave-77v9 krb5kdc[27264](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:09.981056 27363 catalog_manager.cc:1347] Generated new cluster ID: b97c92dab6c3454f9bbdd3839f4e7c82
I20260808 07:11:09.981120 27363 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:09.984361 27353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:09.971783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49398 (local address 127.9.94.62:34557)
0808 07:11:09.972096 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:09.972106 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:09.972165 (+ 59us) server_negotiation.cc:407] Connection header received
0808 07:11:09.972316 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:09.972324 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:09.972393 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:09.973526 (+ 1133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:09.973636 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:09.974899 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:09.976014 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:09.976636 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:09.976754 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:09.980020 (+ 3266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:09.980025 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:09.980026 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:09.980040 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:09.982418 (+ 2378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:09.982869 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:09.982873 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:09.982874 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:09.983029 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:09.983257 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:09.983259 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:09.983259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:09.983643 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:09.983839 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:09.983926 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 07:11:09.984094 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":149,"threads_started":1}
I20260808 07:11:09.992660 27363 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:09.993263 27363 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:10.005043 27363 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab: Generated new TSK 0
I20260808 07:11:10.005327 27363 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:11:10.050649 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:34557
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:10.143337 27375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:10.143567 27375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:10.143594 27375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:10.144723 27375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:10.144763 27375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:10.144790 27375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:11:10.146328 27375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:34557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:10.146555 27375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:10.146759 27375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:10.152552 27385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:10.152555 27381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:10.152555 27383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:10.153116 27375 server_base.cc:1034] running on GCE node
I20260808 07:11:10.153352 27375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:10.153662 27375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:10.154889 27375 hybrid_clock.cc:648] HybridClock initialized: now 1786173070154884 us; error 61 us; skew 500 ppm
Aug 08 07:11:10 dist-test-slave-77v9 krb5kdc[27264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173070, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:10.158474 27375 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:11:10.159031 27375 webserver.cc:460] Webserver started at http://127.9.94.1:40927/ using document root <none> and password file <none>
I20260808 07:11:10.159298 27375 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:10.159382 27375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:10.159538 27375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:10.160728 27375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "a372e2818215424c8c1d5291501e3f77"
format_stamp: "Formatted at 2026-08-08 07:11:10 on dist-test-slave-77v9"
server_key: "ee0d15e67165c30c4b6d4ca87db2d303"
server_key_iv: "a0ce445db5a24cad307b33f2da2854fe"
server_key_version: "encryptionkey@0"
I20260808 07:11:10.161177 27375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "a372e2818215424c8c1d5291501e3f77"
format_stamp: "Formatted at 2026-08-08 07:11:10 on dist-test-slave-77v9"
server_key: "ee0d15e67165c30c4b6d4ca87db2d303"
server_key_iv: "a0ce445db5a24cad307b33f2da2854fe"
server_key_version: "encryptionkey@0"
I20260808 07:11:10.162604 27375 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:10.163481 27393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:10.163679 27375 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:10.163791 27375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "a372e2818215424c8c1d5291501e3f77"
format_stamp: "Formatted at 2026-08-08 07:11:10 on dist-test-slave-77v9"
server_key: "ee0d15e67165c30c4b6d4ca87db2d303"
server_key_iv: "a0ce445db5a24cad307b33f2da2854fe"
server_key_version: "encryptionkey@0"
I20260808 07:11:10.163870 27375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:10.204118 27375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:10.206713 27375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:10.206974 27375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:10.207257 27375 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:10.207645 27375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:10.207702 27375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:10.207744 27375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:10.207774 27375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:10.214162 27375 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:40355
I20260808 07:11:10.214210 27511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:40355 every 8 connection(s)
I20260808 07:11:10.214565 27375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:11:10.219302 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 27375
I20260808 07:11:10.219444 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:11:10.219722 9592 external_mini_cluster.cc:1428] Setting key c4273fcc5b4fe926614766825798f929
Aug 08 07:11:10 dist-test-slave-77v9 krb5kdc[27264](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173070, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:10.226948 27353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.215363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:50615 (local address 127.9.94.62:34557)
0808 07:11:10.215460 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:10.215462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:10.215656 (+ 194us) server_negotiation.cc:407] Connection header received
0808 07:11:10.216205 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:10.216207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:10.216222 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:10.216277 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:10.217403 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.217989 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.219112 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.219489 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.219578 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.222197 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:10.222199 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:10.222199 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:10.222209 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:10.224314 (+ 2105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:10.225179 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:10.225181 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:10.225181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:10.225281 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:10.225809 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:10.225811 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:10.225811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:10.226009 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:10.226095 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:10.226590 (+ 495us) server_negotiation.cc:299] Negotiation successful
0808 07:11:10.226765 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 07:11:10.227054 27514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.215313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:34557 (local address 127.9.94.1:50615)
0808 07:11:10.215496 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:10.215535 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:10.216100 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:10.216332 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:10.216335 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:10.217024 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:10.217233 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.217238 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.218104 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.218105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.218966 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.218968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.219600 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.219601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.219713 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.220425 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:10.220434 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:10.222095 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:10.224508 (+ 2413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:10.224528 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:10.224531 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:10.224977 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:10.225413 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:10.225415 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:10.225415 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:10.225641 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:10.226115 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:10.226124 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:10.226341 (+ 217us) client_negotiation.cc:769] Sending connection context
0808 07:11:10.226509 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 07:11:10.226738 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":100,"threads_started":1}
I20260808 07:11:10.227753 27512 heartbeater.cc:347] Connected to a master server at 127.9.94.62:34557
I20260808 07:11:10.227916 27512 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:10.228140 27512 heartbeater.cc:511] Master 127.9.94.62:34557 requested a full tablet report, sending...
I20260808 07:11:10.228861 27312 ts_manager.cc:194] Registered new tserver with Master: a372e2818215424c8c1d5291501e3f77 (127.9.94.1:40355)
I20260808 07:11:10.229877 27312 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:50615
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:11:10.253288 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:34557
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:10.345652 27517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:10.345873 27517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:10.345898 27517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:10.347126 27517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:10.347177 27517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:10.347204 27517 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:11:10.348729 27517 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:34557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:10.349035 27517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:10.349298 27517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:10.354625 27522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:10.354640 27523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:10.354641 27527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:10.354902 27517 server_base.cc:1034] running on GCE node
I20260808 07:11:10.355206 27517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:10.355477 27517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:10.356683 27517 hybrid_clock.cc:648] HybridClock initialized: now 1786173070356629 us; error 64 us; skew 500 ppm
Aug 08 07:11:10 dist-test-slave-77v9 krb5kdc[27264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173070, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:10.359578 27517 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:11:10.360080 27517 webserver.cc:460] Webserver started at http://127.9.94.2:37621/ using document root <none> and password file <none>
I20260808 07:11:10.360337 27517 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:10.360409 27517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:10.360563 27517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:10.361757 27517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "5e3f9d26e6c342f0b4a8a54677b9b156"
format_stamp: "Formatted at 2026-08-08 07:11:10 on dist-test-slave-77v9"
server_key: "a50b023c06e4f948038f9e3e547d3cdf"
server_key_iv: "63f9bc08b0d7580cfade243c439f6ab9"
server_key_version: "encryptionkey@0"
I20260808 07:11:10.362152 27517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "5e3f9d26e6c342f0b4a8a54677b9b156"
format_stamp: "Formatted at 2026-08-08 07:11:10 on dist-test-slave-77v9"
server_key: "a50b023c06e4f948038f9e3e547d3cdf"
server_key_iv: "63f9bc08b0d7580cfade243c439f6ab9"
server_key_version: "encryptionkey@0"
I20260808 07:11:10.363600 27517 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:11:10.364526 27534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:10.364903 27517 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:10.365031 27517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "5e3f9d26e6c342f0b4a8a54677b9b156"
format_stamp: "Formatted at 2026-08-08 07:11:10 on dist-test-slave-77v9"
server_key: "a50b023c06e4f948038f9e3e547d3cdf"
server_key_iv: "63f9bc08b0d7580cfade243c439f6ab9"
server_key_version: "encryptionkey@0"
I20260808 07:11:10.365127 27517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:10.385133 27517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:10.387624 27517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:10.387833 27517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:10.388151 27517 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:10.388520 27517 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:10.388582 27517 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:10.388623 27517 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:10.388688 27517 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:10.395576 27517 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:35795
I20260808 07:11:10.395620 27653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:35795 every 8 connection(s)
I20260808 07:11:10.395991 27517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:11:10.401016 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 27517
I20260808 07:11:10.401238 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:11:10.401578 9592 external_mini_cluster.cc:1428] Setting key 8f2128162cced36229a5b4147e5716f5
Aug 08 07:11:10 dist-test-slave-77v9 krb5kdc[27264](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173070, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:10.408018 27353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.397013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:36075 (local address 127.9.94.62:34557)
0808 07:11:10.397174 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:10.397177 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:10.397369 (+ 192us) server_negotiation.cc:407] Connection header received
0808 07:11:10.397989 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:10.397990 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:10.398003 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:10.398059 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:10.399225 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.399774 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.401160 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.401458 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.401559 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.404618 (+ 3059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:10.404620 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:10.404620 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:10.404628 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:10.406386 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:10.406961 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:10.406962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:10.406963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:10.407030 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:10.407298 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:10.407299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:10.407299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:10.407432 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:10.407515 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:10.407814 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 07:11:10.407921 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260808 07:11:10.408213 27656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.396878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:34557 (local address 127.9.94.2:36075)
0808 07:11:10.397210 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:10.397271 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:10.397856 (+ 585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:10.398146 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:10.398150 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:10.398862 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:10.399097 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.399101 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.400007 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.400010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.401045 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.401048 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.401574 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.401575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.401769 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.402507 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:10.402518 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:10.404502 (+ 1984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:10.406608 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:10.406616 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:10.406619 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:10.406872 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:10.407108 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:10.407109 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:10.407110 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:10.407229 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:10.407503 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:10.407510 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:10.407669 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 07:11:10.407781 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 07:11:10.407962 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":126,"threads_started":1}
I20260808 07:11:10.409081 27654 heartbeater.cc:347] Connected to a master server at 127.9.94.62:34557
I20260808 07:11:10.409214 27654 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:10.409435 27654 heartbeater.cc:511] Master 127.9.94.62:34557 requested a full tablet report, sending...
I20260808 07:11:10.409886 27312 ts_manager.cc:194] Registered new tserver with Master: 5e3f9d26e6c342f0b4a8a54677b9b156 (127.9.94.2:35795)
I20260808 07:11:10.410331 27312 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:36075
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:11:10.437058 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:34557
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:34565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:10.533638 27660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:10.533847 27660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:10.533872 27660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:10.535039 27660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:10.535087 27660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:10.535115 27660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:11:10.536638 27660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:34565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:34557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:10.537055 27660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:10.537364 27660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:10.543401 27666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:10.543408 27665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:10.543408 27668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:10.543599 27660 server_base.cc:1034] running on GCE node
I20260808 07:11:10.544050 27660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:10.544353 27660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:10.545521 27660 hybrid_clock.cc:648] HybridClock initialized: now 1786173070545508 us; error 32 us; skew 500 ppm
Aug 08 07:11:10 dist-test-slave-77v9 krb5kdc[27264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173070, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:10.548411 27660 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:11:10.548969 27660 webserver.cc:460] Webserver started at http://127.9.94.3:44271/ using document root <none> and password file <none>
I20260808 07:11:10.549225 27660 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:10.549299 27660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:10.549449 27660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:10.550521 27660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "8520eec0d990489b92a296f682bbf707"
format_stamp: "Formatted at 2026-08-08 07:11:10 on dist-test-slave-77v9"
server_key: "f9415521fa1dbf38001a264c9b3b8ba5"
server_key_iv: "fd2e7e00ec985115c487d89503fb910f"
server_key_version: "encryptionkey@0"
I20260808 07:11:10.550892 27660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "8520eec0d990489b92a296f682bbf707"
format_stamp: "Formatted at 2026-08-08 07:11:10 on dist-test-slave-77v9"
server_key: "f9415521fa1dbf38001a264c9b3b8ba5"
server_key_iv: "fd2e7e00ec985115c487d89503fb910f"
server_key_version: "encryptionkey@0"
I20260808 07:11:10.552461 27660 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:11:10.553484 27677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:10.553735 27660 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:11:10.553822 27660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "8520eec0d990489b92a296f682bbf707"
format_stamp: "Formatted at 2026-08-08 07:11:10 on dist-test-slave-77v9"
server_key: "f9415521fa1dbf38001a264c9b3b8ba5"
server_key_iv: "fd2e7e00ec985115c487d89503fb910f"
server_key_version: "encryptionkey@0"
I20260808 07:11:10.553908 27660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:10.581620 27660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:10.584061 27660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:10.584256 27660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:10.584895 27660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:10.585283 27660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:10.585348 27660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:10.585402 27660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:10.585449 27660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:10.591732 27660 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:42293
I20260808 07:11:10.591780 27800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:42293 every 8 connection(s)
I20260808 07:11:10.592149 27660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:11:10.594576 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 27660
I20260808 07:11:10.594717 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:11:10.594954 9592 external_mini_cluster.cc:1428] Setting key d36b7f0bd03795122a300c66b111a18f
Aug 08 07:11:10 dist-test-slave-77v9 krb5kdc[27264](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173070, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:10.605033 27353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.593472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:59155 (local address 127.9.94.62:34557)
0808 07:11:10.593708 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:10.593711 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:10.593769 (+ 58us) server_negotiation.cc:407] Connection header received
0808 07:11:10.594450 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:10.594452 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:10.594466 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:10.594540 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:10.595948 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.596623 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.598209 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.598465 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.598532 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.601432 (+ 2900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:10.601434 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:10.601435 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:10.601444 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:10.603260 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:10.603827 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:10.603828 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:10.603828 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:10.603898 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:10.604190 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:10.604191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:10.604191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:10.604367 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:10.604454 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:10.604795 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 07:11:10.604921 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182}
I20260808 07:11:10.605300 27803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.593399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:34557 (local address 127.9.94.3:59155)
0808 07:11:10.593621 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:10.593669 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:10.594237 (+ 568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:10.594657 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:10.594663 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:10.595501 (+ 838us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:10.595848 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.595854 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.596939 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.596940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.598090 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.598094 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.598570 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.598571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.598704 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.599502 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:10.599511 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:10.601293 (+ 1782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:10.603405 (+ 2112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:10.603414 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:10.603416 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:10.603690 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:10.603984 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:10.603985 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:10.603985 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:10.604106 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:10.604456 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:10.604464 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:10.604638 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 07:11:10.604768 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 07:11:10.604993 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":130,"threads_started":1}
I20260808 07:11:10.605967 27801 heartbeater.cc:347] Connected to a master server at 127.9.94.62:34557
I20260808 07:11:10.606069 27801 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:10.606295 27801 heartbeater.cc:511] Master 127.9.94.62:34557 requested a full tablet report, sending...
I20260808 07:11:10.607048 27312 ts_manager.cc:194] Registered new tserver with Master: 8520eec0d990489b92a296f682bbf707 (127.9.94.3:42293)
I20260808 07:11:10.607623 27312 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:59155
I20260808 07:11:10.608108 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:11:10.617388 27353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.609794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49400 (local address 127.9.94.62:34557)
0808 07:11:10.609868 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:10.609870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:10.609996 (+ 126us) server_negotiation.cc:407] Connection header received
0808 07:11:10.610021 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:10.610022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:10.610031 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:10.610078 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:10.611146 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.611647 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.612431 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.612623 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.612687 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.614365 (+ 1678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:10.614366 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:10.614367 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:10.614381 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:10.615884 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:10.616308 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:10.616309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:10.616309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:10.616380 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:10.616625 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:10.616626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:10.616626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:10.616890 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:10.617015 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:10.617133 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 07:11:10.617265 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 07:11:10.619560 27312 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49400:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:11:10.621613 27312 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:11:10.629451 27814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.624298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:42293 (local address 127.0.0.1:45670)
0808 07:11:10.624864 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:10.624875 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:10.624940 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:10.625274 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:10.625275 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:10.625279 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:10.625342 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.625344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.626813 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.626814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.628219 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.628222 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.629087 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.629089 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.629178 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.629193 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 07:11:10.629295 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 07:11:10.629359 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"mutex_wait_us":78,"thread_start_us":51,"threads_started":1}
I20260808 07:11:10.629467 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.624662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45670 (local address 127.9.94.3:42293)
0808 07:11:10.624862 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:10.624866 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:10.624936 (+ 70us) server_negotiation.cc:407] Connection header received
0808 07:11:10.625065 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:10.625068 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:10.625087 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:10.625194 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:10.625444 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.626617 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.628354 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.628976 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.629084 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.629148 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:10.629329 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 07:11:10.629375 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":95,"threads_started":1}
I20260808 07:11:10.630124 27816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.624512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:35795 (local address 127.0.0.1:58028)
0808 07:11:10.625094 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:10.625106 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:10.625164 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:10.625645 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:10.625646 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:10.625647 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:10.625696 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.625698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.626649 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.626650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.628252 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.628255 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.629415 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.629416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.629479 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.629483 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:11:10.629901 (+ 418us) client_negotiation.cc:240] Negotiation successful
0808 07:11:10.629954 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"mutex_wait_us":71,"thread_start_us":84,"threads_started":1}
I20260808 07:11:10.630343 27733 tablet_service.cc:1467] Processing CreateTablet for tablet 238a0accac374b0e969ca4494cd1daa7 (DEFAULT_TABLE table=test-table [id=7346ea5646a148b690c1c1e3155d2644]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:10.630631 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.624779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58028 (local address 127.9.94.2:35795)
0808 07:11:10.625497 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:10.625501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:10.625508 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:11:10.625541 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:10.625542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:10.625554 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:10.625647 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:10.625761 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.626538 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.628365 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.629206 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.629320 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.629384 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:10.630490 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0808 07:11:10.630542 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":213,"threads_started":1}
I20260808 07:11:10.630801 27813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.624266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:40355 (local address 127.0.0.1:38266)
0808 07:11:10.624615 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:10.624658 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:10.624731 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:10.625096 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:10.625099 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:10.625102 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:10.625172 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.625174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.627980 (+ 2806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.627981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.629269 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.629272 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.630505 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.630507 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.630581 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.630587 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:11:10.630660 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 07:11:10.630705 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"mutex_wait_us":3,"thread_start_us":103,"threads_started":1}
I20260808 07:11:10.630832 27733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 238a0accac374b0e969ca4494cd1daa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:10.631083 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.624422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38266 (local address 127.9.94.1:40355)
0808 07:11:10.624684 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:10.624690 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:10.624709 (+ 19us) server_negotiation.cc:407] Connection header received
0808 07:11:10.624908 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:10.624911 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:10.624929 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:10.625003 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:10.625258 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.626564 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.629392 (+ 2828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.630346 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.630440 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.630499 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:10.630927 (+ 428us) server_negotiation.cc:299] Negotiation successful
0808 07:11:10.630984 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":88,"threads_started":1}
I20260808 07:11:10.631243 27586 tablet_service.cc:1467] Processing CreateTablet for tablet 238a0accac374b0e969ca4494cd1daa7 (DEFAULT_TABLE table=test-table [id=7346ea5646a148b690c1c1e3155d2644]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:10.631587 27586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 238a0accac374b0e969ca4494cd1daa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:10.633714 27444 tablet_service.cc:1467] Processing CreateTablet for tablet 238a0accac374b0e969ca4494cd1daa7 (DEFAULT_TABLE table=test-table [id=7346ea5646a148b690c1c1e3155d2644]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:10.634204 27444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 238a0accac374b0e969ca4494cd1daa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:10.634315 27819 tablet_bootstrap.cc:492] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156: Bootstrap starting.
I20260808 07:11:10.635004 27819 tablet_bootstrap.cc:654] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:10.635536 27819 log.cc:824] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:10.635864 27820 tablet_bootstrap.cc:492] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707: Bootstrap starting.
I20260808 07:11:10.636510 27820 tablet_bootstrap.cc:654] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:10.636739 27819 tablet_bootstrap.cc:492] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156: No bootstrap required, opened a new log
I20260808 07:11:10.636852 27819 ts_tablet_manager.cc:1397] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:11:10.637151 27820 log.cc:824] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:10.637401 27822 tablet_bootstrap.cc:492] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77: Bootstrap starting.
I20260808 07:11:10.638083 27822 tablet_bootstrap.cc:654] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:10.638087 27820 tablet_bootstrap.cc:492] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707: No bootstrap required, opened a new log
I20260808 07:11:10.638161 27820 ts_tablet_manager.cc:1397] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:11:10.638685 27822 log.cc:824] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:10.638857 27819 raft_consensus.cc:348] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a372e2818215424c8c1d5291501e3f77" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40355 } } peers { permanent_uuid: "8520eec0d990489b92a296f682bbf707" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42293 } } peers { permanent_uuid: "5e3f9d26e6c342f0b4a8a54677b9b156" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 35795 } }
I20260808 07:11:10.639079 27819 raft_consensus.cc:374] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:10.639128 27819 raft_consensus.cc:729] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e3f9d26e6c342f0b4a8a54677b9b156, State: Initialized, Role: FOLLOWER
I20260808 07:11:10.639250 27819 consensus_queue.cc:260] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a372e2818215424c8c1d5291501e3f77" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40355 } } peers { permanent_uuid: "8520eec0d990489b92a296f682bbf707" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42293 } } peers { permanent_uuid: "5e3f9d26e6c342f0b4a8a54677b9b156" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 35795 } }
I20260808 07:11:10.639583 27819 ts_tablet_manager.cc:1428] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:11:10.639674 27654 heartbeater.cc:503] Master 127.9.94.62:34557 was elected leader, sending a full tablet report...
I20260808 07:11:10.640679 27820 raft_consensus.cc:348] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a372e2818215424c8c1d5291501e3f77" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40355 } } peers { permanent_uuid: "8520eec0d990489b92a296f682bbf707" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42293 } } peers { permanent_uuid: "5e3f9d26e6c342f0b4a8a54677b9b156" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 35795 } }
I20260808 07:11:10.640887 27820 raft_consensus.cc:374] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:10.640901 27822 tablet_bootstrap.cc:492] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77: No bootstrap required, opened a new log
I20260808 07:11:10.640938 27820 raft_consensus.cc:729] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8520eec0d990489b92a296f682bbf707, State: Initialized, Role: FOLLOWER
I20260808 07:11:10.640978 27822 ts_tablet_manager.cc:1397] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 07:11:10.641054 27820 consensus_queue.cc:260] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a372e2818215424c8c1d5291501e3f77" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40355 } } peers { permanent_uuid: "8520eec0d990489b92a296f682bbf707" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42293 } } peers { permanent_uuid: "5e3f9d26e6c342f0b4a8a54677b9b156" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 35795 } }
I20260808 07:11:10.641346 27820 ts_tablet_manager.cc:1428] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 07:11:10.641420 27801 heartbeater.cc:503] Master 127.9.94.62:34557 was elected leader, sending a full tablet report...
I20260808 07:11:10.642539 27822 raft_consensus.cc:348] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a372e2818215424c8c1d5291501e3f77" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40355 } } peers { permanent_uuid: "8520eec0d990489b92a296f682bbf707" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42293 } } peers { permanent_uuid: "5e3f9d26e6c342f0b4a8a54677b9b156" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 35795 } }
I20260808 07:11:10.642669 27822 raft_consensus.cc:374] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:10.642693 27822 raft_consensus.cc:729] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a372e2818215424c8c1d5291501e3f77, State: Initialized, Role: FOLLOWER
I20260808 07:11:10.642832 27822 consensus_queue.cc:260] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a372e2818215424c8c1d5291501e3f77" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40355 } } peers { permanent_uuid: "8520eec0d990489b92a296f682bbf707" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42293 } } peers { permanent_uuid: "5e3f9d26e6c342f0b4a8a54677b9b156" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 35795 } }
I20260808 07:11:10.643093 27822 ts_tablet_manager.cc:1428] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:11:10.643158 27512 heartbeater.cc:503] Master 127.9.94.62:34557 was elected leader, sending a full tablet report...
W20260808 07:11:10.646598 27655 tablet.cc:2369] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:11:10.715512 27513 tablet.cc:2369] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:11:10.791862 27827 raft_consensus.cc:482] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:11:10.792029 27827 raft_consensus.cc:504] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a372e2818215424c8c1d5291501e3f77" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40355 } } peers { permanent_uuid: "8520eec0d990489b92a296f682bbf707" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42293 } } peers { permanent_uuid: "5e3f9d26e6c342f0b4a8a54677b9b156" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 35795 } }
I20260808 07:11:10.792570 27827 leader_election.cc:288] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8520eec0d990489b92a296f682bbf707 (127.9.94.3:42293), 5e3f9d26e6c342f0b4a8a54677b9b156 (127.9.94.2:35795)
I20260808 07:11:10.796870 27828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.792774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:42293 (local address 127.9.94.1:37927)
0808 07:11:10.792964 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:10.792978 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:10.793079 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:10.793267 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:10.793268 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:10.793271 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:10.793394 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.793397 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.794389 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.794390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.795659 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.795662 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.796525 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.796526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.796613 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.796620 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 07:11:10.796701 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 07:11:10.796735 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":7,"thread_start_us":116,"threads_started":1}
I20260808 07:11:10.796945 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.793172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:54615 (local address 127.9.94.2:35795)
0808 07:11:10.793249 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:10.793251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:10.793262 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:11:10.793292 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:10.793293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:10.793306 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:10.793356 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:10.793533 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.794249 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.795781 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.796404 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.796501 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.796513 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:10.796776 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 07:11:10.796871 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 07:11:10.796979 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.792941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:37927 (local address 127.9.94.3:42293)
0808 07:11:10.793022 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:10.793025 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:10.793060 (+ 35us) server_negotiation.cc:407] Connection header received
0808 07:11:10.793164 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:10.793165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:10.793177 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:10.793259 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:10.793480 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.794251 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.795781 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.796401 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.796500 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.796513 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:10.796843 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 07:11:10.796907 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 07:11:10.796986 27829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.793049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:35795 (local address 127.9.94.1:54615)
0808 07:11:10.793175 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:10.793185 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:10.793239 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:10.793378 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:10.793379 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:10.793381 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:10.793458 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.793460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.794361 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.794362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.795659 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:10.795662 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.796524 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.796525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:10.796613 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.796621 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 07:11:10.796687 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 07:11:10.796735 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":72,"thread_start_us":64,"threads_started":1}
I20260808 07:11:10.797386 27753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "238a0accac374b0e969ca4494cd1daa7" candidate_uuid: "a372e2818215424c8c1d5291501e3f77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8520eec0d990489b92a296f682bbf707" is_pre_election: true
I20260808 07:11:10.797585 27753 raft_consensus.cc:2454] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a372e2818215424c8c1d5291501e3f77 in term 0.
I20260808 07:11:10.797909 27397 leader_election.cc:302] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8520eec0d990489b92a296f682bbf707, a372e2818215424c8c1d5291501e3f77; no voters:
I20260808 07:11:10.797883 27607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "238a0accac374b0e969ca4494cd1daa7" candidate_uuid: "a372e2818215424c8c1d5291501e3f77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e3f9d26e6c342f0b4a8a54677b9b156" is_pre_election: true
I20260808 07:11:10.798012 27607 raft_consensus.cc:2454] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a372e2818215424c8c1d5291501e3f77 in term 0.
I20260808 07:11:10.798066 27827 raft_consensus.cc:2781] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:11:10.798137 27827 raft_consensus.cc:482] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:11:10.798171 27827 raft_consensus.cc:3037] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:10.798978 27827 raft_consensus.cc:504] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a372e2818215424c8c1d5291501e3f77" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40355 } } peers { permanent_uuid: "8520eec0d990489b92a296f682bbf707" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42293 } } peers { permanent_uuid: "5e3f9d26e6c342f0b4a8a54677b9b156" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 35795 } }
I20260808 07:11:10.799136 27827 leader_election.cc:288] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [CANDIDATE]: Term 1 election: Requested vote from peers 8520eec0d990489b92a296f682bbf707 (127.9.94.3:42293), 5e3f9d26e6c342f0b4a8a54677b9b156 (127.9.94.2:35795)
I20260808 07:11:10.799373 27753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "238a0accac374b0e969ca4494cd1daa7" candidate_uuid: "a372e2818215424c8c1d5291501e3f77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8520eec0d990489b92a296f682bbf707"
I20260808 07:11:10.799396 27607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "238a0accac374b0e969ca4494cd1daa7" candidate_uuid: "a372e2818215424c8c1d5291501e3f77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e3f9d26e6c342f0b4a8a54677b9b156"
I20260808 07:11:10.799479 27753 raft_consensus.cc:3037] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:10.799507 27607 raft_consensus.cc:3037] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:10.800469 27607 raft_consensus.cc:2454] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a372e2818215424c8c1d5291501e3f77 in term 1.
I20260808 07:11:10.800485 27753 raft_consensus.cc:2454] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a372e2818215424c8c1d5291501e3f77 in term 1.
I20260808 07:11:10.800676 27397 leader_election.cc:302] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e3f9d26e6c342f0b4a8a54677b9b156, a372e2818215424c8c1d5291501e3f77; no voters:
I20260808 07:11:10.800860 27827 raft_consensus.cc:2781] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:10.801060 27827 raft_consensus.cc:686] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [term 1 LEADER]: Becoming Leader. State: Replica: a372e2818215424c8c1d5291501e3f77, State: Running, Role: LEADER
I20260808 07:11:10.801185 27827 consensus_queue.cc:237] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a372e2818215424c8c1d5291501e3f77" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40355 } } peers { permanent_uuid: "8520eec0d990489b92a296f682bbf707" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42293 } } peers { permanent_uuid: "5e3f9d26e6c342f0b4a8a54677b9b156" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 35795 } }
I20260808 07:11:10.802537 27312 catalog_manager.cc:5495] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 reported cstate change: term changed from 0 to 1, leader changed from <none> to a372e2818215424c8c1d5291501e3f77 (127.9.94.1). New cstate: current_term: 1 leader_uuid: "a372e2818215424c8c1d5291501e3f77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a372e2818215424c8c1d5291501e3f77" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 40355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8520eec0d990489b92a296f682bbf707" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e3f9d26e6c342f0b4a8a54677b9b156" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260808 07:11:10.816541 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.813932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38272 (local address 127.9.94.1:40355)
0808 07:11:10.813997 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:10.813999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:10.814029 (+ 30us) server_negotiation.cc:407] Connection header received
0808 07:11:10.814130 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:10.814131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:10.814154 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:10.814233 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:10.814373 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.814888 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.815740 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:10.815945 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:10.816030 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:10.816185 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:10.816298 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:10.816393 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:10.816419 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 07:11:10.816442 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 07:11:10.819161 27753 raft_consensus.cc:1261] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707 [term 1 FOLLOWER]: Refusing update from remote peer a372e2818215424c8c1d5291501e3f77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:10.819211 27607 raft_consensus.cc:1261] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156 [term 1 FOLLOWER]: Refusing update from remote peer a372e2818215424c8c1d5291501e3f77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:10.819764 27827 consensus_queue.cc:1035] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e3f9d26e6c342f0b4a8a54677b9b156" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:10.819957 27830 consensus_queue.cc:1035] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8520eec0d990489b92a296f682bbf707" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 42293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:10.823487 27835 mvcc.cc:205] Tried to move back new op lower bound from 7316164898071089152 to 7316164898002419712. Current Snapshot: MvccSnapshot[applied={T|T < 7316164898071089152 or (T in {7316164898071089152})}]
I20260808 07:11:10.823724 27834 mvcc.cc:205] Tried to move back new op lower bound from 7316164898071089152 to 7316164898002419712. Current Snapshot: MvccSnapshot[applied={T|T < 7316164898071089152}]
I20260808 07:11:10.825671 27311 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:11:10.825814 27311 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:11:10.826659 27311 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 501e9f004d204071bfe4b932b558e1ab: Sending DeleteTablet for 3 replicas of tablet 238a0accac374b0e969ca4494cd1daa7
I20260808 07:11:10.827020 27444 tablet_service.cc:1514] Processing DeleteTablet for tablet 238a0accac374b0e969ca4494cd1daa7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:10 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:38266
I20260808 07:11:10.827291 27733 tablet_service.cc:1514] Processing DeleteTablet for tablet 238a0accac374b0e969ca4494cd1daa7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:10 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:45670
I20260808 07:11:10.827283 27586 tablet_service.cc:1514] Processing DeleteTablet for tablet 238a0accac374b0e969ca4494cd1daa7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:10 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:58028
I20260808 07:11:10.827663 27843 tablet_replica.cc:330] T 238a0accac374b0e969ca4494cd1daa7 P a372e2818215424c8c1d5291501e3f77: stopping tablet replica
I20260808 07:11:10.827777 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 27375
I20260808 07:11:10.830158 27846 tablet_replica.cc:330] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156: stopping tablet replica
I20260808 07:11:10.830294 27846 raft_consensus.cc:2229] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:11:10.830416 27846 raft_consensus.cc:2258] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:10.830576 27844 tablet_replica.cc:330] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707: stopping tablet replica
I20260808 07:11:10.830680 27844 raft_consensus.cc:2229] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:11:10.830801 27844 raft_consensus.cc:2258] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:10.831238 27844 ts_tablet_manager.cc:1905] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:11:10.833156 27844 ts_tablet_manager.cc:1918] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:11:10.833284 27844 log.cc:1196] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/238a0accac374b0e969ca4494cd1daa7
I20260808 07:11:10.833285 27846 ts_tablet_manager.cc:1905] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:11:10.833650 27844 ts_tablet_manager.cc:1939] T 238a0accac374b0e969ca4494cd1daa7 P 8520eec0d990489b92a296f682bbf707: Deleting consensus metadata
I20260808 07:11:10.834520 27297 catalog_manager.cc:4841] TS 8520eec0d990489b92a296f682bbf707 (127.9.94.3:42293): tablet 238a0accac374b0e969ca4494cd1daa7 (table test-table [id=7346ea5646a148b690c1c1e3155d2644]) successfully deleted
I20260808 07:11:10.835543 27846 ts_tablet_manager.cc:1918] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:11:10.835632 27846 log.cc:1196] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/238a0accac374b0e969ca4494cd1daa7
W20260808 07:11:10.835772 27295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:40355 (error 108)
I20260808 07:11:10.836007 27846 ts_tablet_manager.cc:1939] T 238a0accac374b0e969ca4494cd1daa7 P 5e3f9d26e6c342f0b4a8a54677b9b156: Deleting consensus metadata
I20260808 07:11:10.836136 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 27517
I20260808 07:11:10.837021 27814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.836232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:40355 (local address 127.0.0.1:38286)
0808 07:11:10.836938 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:10.836981 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":682}
W20260808 07:11:10.837790 27295 catalog_manager.cc:4584] TS a372e2818215424c8c1d5291501e3f77 (127.9.94.1:40355): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 238a0accac374b0e969ca4494cd1daa7: Network error: Client connection negotiation failed: client connection to 127.9.94.1:40355: connect: Connection refused (error 111)
I20260808 07:11:10.844750 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 27660
I20260808 07:11:10.844805 27814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:10.844596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:35795 (local address 127.0.0.1:58042)
0808 07:11:10.844686 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:10.844759 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.2:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 07:11:10.850776 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 27279
2026-08-08T07:11:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2360 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T07:11:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:10Z Disabled control of system clock
I20260808 07:11:10.887171 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:38503
--webserver_interface=127.9.94.62
--webserver_port=0
--builtin_ntp_servers=127.9.94.20:39069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:38503
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:11:10.983405 27851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:10.983671 27851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:10.983695 27851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:10.985044 27851 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:10.985097 27851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:10.985110 27851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:10.985123 27851 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:10.985136 27851 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:10.986581 27851 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:39069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:38503
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:38503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:10.986860 27851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:10.987169 27851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:10.992442 27856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:10.992466 27859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:10.992442 27857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:10.993038 27851 server_base.cc:1034] running on GCE node
I20260808 07:11:10.993579 27851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:10.993947 27851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:10.995148 27851 hybrid_clock.cc:648] HybridClock initialized: now 1786173070995128 us; error 51 us; skew 500 ppm
I20260808 07:11:10.996872 27851 webserver.cc:460] Webserver started at http://127.9.94.62:41577/ using document root <none> and password file <none>
I20260808 07:11:10.997174 27851 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:10.997248 27851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:10.997411 27851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:10.998569 27851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "08e10d4c3d3a49a9805d30b87bda5027"
format_stamp: "Formatted at 2026-08-08 07:11:10 on dist-test-slave-77v9"
server_key: "083c8f5116094a651628b87d48f9c73c"
server_key_iv: "e9b404c86f6f57ff4cf727a58a6b4b8b"
server_key_version: "encryptionkey@0"
I20260808 07:11:10.998960 27851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "08e10d4c3d3a49a9805d30b87bda5027"
format_stamp: "Formatted at 2026-08-08 07:11:10 on dist-test-slave-77v9"
server_key: "083c8f5116094a651628b87d48f9c73c"
server_key_iv: "e9b404c86f6f57ff4cf727a58a6b4b8b"
server_key_version: "encryptionkey@0"
I20260808 07:11:11.000481 27851 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:11:11.001636 27865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:11.002084 27851 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:11.002216 27851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "08e10d4c3d3a49a9805d30b87bda5027"
format_stamp: "Formatted at 2026-08-08 07:11:10 on dist-test-slave-77v9"
server_key: "083c8f5116094a651628b87d48f9c73c"
server_key_iv: "e9b404c86f6f57ff4cf727a58a6b4b8b"
server_key_version: "encryptionkey@0"
I20260808 07:11:11.002305 27851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:11.025720 27851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:11.026101 27851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:11.026273 27851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:11.031338 27851 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:38503
I20260808 07:11:11.031430 27922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:38503 every 8 connection(s)
I20260808 07:11:11.031826 27851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:11.033174 27923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:11.034989 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 27851
I20260808 07:11:11.035127 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:11.035354 9592 external_mini_cluster.cc:1428] Setting key 2216a57b3c23604f3c02925762d3ed16
I20260808 07:11:11.036262 27923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027: Bootstrap starting.
I20260808 07:11:11.036993 27923 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:11.037325 27923 log.cc:824] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:11.038582 27923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027: No bootstrap required, opened a new log
I20260808 07:11:11.041728 27926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.036024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38300 (local address 127.9.94.62:38503)
0808 07:11:11.036255 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:11.036263 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:11.036292 (+ 29us) server_negotiation.cc:407] Connection header received
0808 07:11:11.036914 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:11.036922 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:11.036993 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:11.037167 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:11.037438 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.038442 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.039423 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.039968 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.040144 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.041013 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:11.041018 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:11.041018 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:11.041209 (+ 191us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:11.041246 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:11.041258 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:11.041337 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:11.041432 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 07:11:11.041530 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":106,"threads_started":1}
I20260808 07:11:11.041906 27923 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08e10d4c3d3a49a9805d30b87bda5027" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38503 } }
I20260808 07:11:11.042150 27923 raft_consensus.cc:374] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:11.042209 27923 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e10d4c3d3a49a9805d30b87bda5027, State: Initialized, Role: FOLLOWER
I20260808 07:11:11.042357 27923 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08e10d4c3d3a49a9805d30b87bda5027" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38503 } }
I20260808 07:11:11.042469 27923 raft_consensus.cc:388] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:11.042508 27923 raft_consensus.cc:482] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:11.042582 27923 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:11.043274 27923 raft_consensus.cc:504] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08e10d4c3d3a49a9805d30b87bda5027" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38503 } }
I20260808 07:11:11.043398 27923 leader_election.cc:302] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 08e10d4c3d3a49a9805d30b87bda5027; no voters:
I20260808 07:11:11.043599 27923 leader_election.cc:288] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:11.043802 27928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:11.043917 27923 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:11.044024 27928 raft_consensus.cc:686] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [term 1 LEADER]: Becoming Leader. State: Replica: 08e10d4c3d3a49a9805d30b87bda5027, State: Running, Role: LEADER
I20260808 07:11:11.044190 27928 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08e10d4c3d3a49a9805d30b87bda5027" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38503 } }
I20260808 07:11:11.044771 27930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08e10d4c3d3a49a9805d30b87bda5027. Latest consensus state: current_term: 1 leader_uuid: "08e10d4c3d3a49a9805d30b87bda5027" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08e10d4c3d3a49a9805d30b87bda5027" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38503 } } }
I20260808 07:11:11.044888 27930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:11.045049 27929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "08e10d4c3d3a49a9805d30b87bda5027" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08e10d4c3d3a49a9805d30b87bda5027" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38503 } } }
I20260808 07:11:11.045145 27929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:11.045543 27937 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:11.046466 27937 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:11.048620 27937 catalog_manager.cc:1347] Generated new cluster ID: c334914429f24cc3a4cbf28d220557bd
I20260808 07:11:11.048696 27937 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:11.082346 27937 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:11.083105 27937 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:11.089422 27937 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027: Generated new TSK 0
I20260808 07:11:11.089663 27937 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:11.094723 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:38503
--builtin_ntp_servers=127.9.94.20:39069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:11:11.202499 27947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:11.202775 27947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:11.202821 27947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:11.204082 27947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:11.204156 27947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:11.204205 27947 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:11:11.205956 27947 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:39069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:38503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27947
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:11.206249 27947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:11.206614 27947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:11.212241 27953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:11.212239 27955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:11.212330 27952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:11.212801 27947 server_base.cc:1034] running on GCE node
I20260808 07:11:11.213073 27947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:11.213366 27947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:11.214568 27947 hybrid_clock.cc:648] HybridClock initialized: now 1786173071214545 us; error 36 us; skew 500 ppm
I20260808 07:11:11.216248 27947 webserver.cc:460] Webserver started at http://127.9.94.1:33349/ using document root <none> and password file <none>
I20260808 07:11:11.216559 27947 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:11.216625 27947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:11.216759 27947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:11.218263 27947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8"
format_stamp: "Formatted at 2026-08-08 07:11:11 on dist-test-slave-77v9"
server_key: "15b6cf164b396d1188b5483a10bcef4d"
server_key_iv: "055ee5e53a8eb11d89101abdb03e7d09"
server_key_version: "encryptionkey@0"
I20260808 07:11:11.218712 27947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8"
format_stamp: "Formatted at 2026-08-08 07:11:11 on dist-test-slave-77v9"
server_key: "15b6cf164b396d1188b5483a10bcef4d"
server_key_iv: "055ee5e53a8eb11d89101abdb03e7d09"
server_key_version: "encryptionkey@0"
I20260808 07:11:11.220595 27947 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:11:11.222119 27962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:11.222430 27947 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:11.222545 27947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8"
format_stamp: "Formatted at 2026-08-08 07:11:11 on dist-test-slave-77v9"
server_key: "15b6cf164b396d1188b5483a10bcef4d"
server_key_iv: "055ee5e53a8eb11d89101abdb03e7d09"
server_key_version: "encryptionkey@0"
I20260808 07:11:11.222640 27947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:11.257999 27947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:11.258564 27947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:11.258756 27947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:11.259053 27947 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:11.259567 27947 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:11.259769 27947 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:11.259889 27947 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:11.259943 27947 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:11.266994 27947 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:46855
I20260808 07:11:11.267045 28082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:46855 every 8 connection(s)
I20260808 07:11:11.267426 27947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:11:11.272888 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 27947
I20260808 07:11:11.273020 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:11:11.273272 9592 external_mini_cluster.cc:1428] Setting key 3f9ce53c6113473ba29f62103a96c567
I20260808 07:11:11.273698 27926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.268365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:46203 (local address 127.9.94.62:38503)
0808 07:11:11.268606 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:11.268609 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:11.268776 (+ 167us) server_negotiation.cc:407] Connection header received
0808 07:11:11.269421 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:11.269422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:11.269440 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:11.269500 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:11.270222 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.270784 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.271792 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.272023 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.272112 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.273240 (+ 1128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:11.273241 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:11.273242 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:11.273248 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:11.273265 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:11.273269 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:11.273342 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:11.273578 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 07:11:11.273609 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 07:11:11.273998 28085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.268235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:38503 (local address 127.9.94.1:46203)
0808 07:11:11.268618 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:11.268673 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:11.269290 (+ 617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:11.269575 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:11.269579 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:11.269587 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:11.270111 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.270116 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.270887 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.270888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.271686 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.271688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.272127 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.272128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.272260 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.273054 (+ 794us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:11:11.273055 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:11.273096 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:11:11.273125 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:11.273440 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:11.273447 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:11.273451 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:11:11.273544 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 07:11:11.273691 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":153,"threads_started":1}
I20260808 07:11:11.274482 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:38503
--builtin_ntp_servers=127.9.94.20:39069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 07:11:11.274539 28083 heartbeater.cc:347] Connected to a master server at 127.9.94.62:38503
I20260808 07:11:11.274632 28083 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:11.274842 28083 heartbeater.cc:511] Master 127.9.94.62:38503 requested a full tablet report, sending...
I20260808 07:11:11.275417 27883 ts_manager.cc:194] Registered new tserver with Master: e49dcca7d73f45a8b3fc6ac60e2778e8 (127.9.94.1:46855)
I20260808 07:11:11.276266 27883 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.94.1:46203
W20260808 07:11:11.364929 28086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:11.365206 28086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:11.365244 28086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:11.366397 28086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:11.366479 28086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:11.366525 28086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:11:11.367944 28086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:39069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:38503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:11.368240 28086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:11.368574 28086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:11.374087 28095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:11.374114 28093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:11.374125 28091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:11.374382 28086 server_base.cc:1034] running on GCE node
I20260808 07:11:11.374586 28086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:11.374812 28086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:11.375996 28086 hybrid_clock.cc:648] HybridClock initialized: now 1786173071375980 us; error 31 us; skew 500 ppm
I20260808 07:11:11.377619 28086 webserver.cc:460] Webserver started at http://127.9.94.2:45875/ using document root <none> and password file <none>
I20260808 07:11:11.377987 28086 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:11.378046 28086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:11.378193 28086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:11.379360 28086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "5d76879435454613b76697480b27a287"
format_stamp: "Formatted at 2026-08-08 07:11:11 on dist-test-slave-77v9"
server_key: "35e72a3e79add9d02aaf854822661d78"
server_key_iv: "1f3968a8e5c94086e7b62ed31474ad88"
server_key_version: "encryptionkey@0"
I20260808 07:11:11.379863 28086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "5d76879435454613b76697480b27a287"
format_stamp: "Formatted at 2026-08-08 07:11:11 on dist-test-slave-77v9"
server_key: "35e72a3e79add9d02aaf854822661d78"
server_key_iv: "1f3968a8e5c94086e7b62ed31474ad88"
server_key_version: "encryptionkey@0"
I20260808 07:11:11.381595 28086 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260808 07:11:11.382567 28101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:11.382763 28086 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:11.382874 28086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "5d76879435454613b76697480b27a287"
format_stamp: "Formatted at 2026-08-08 07:11:11 on dist-test-slave-77v9"
server_key: "35e72a3e79add9d02aaf854822661d78"
server_key_iv: "1f3968a8e5c94086e7b62ed31474ad88"
server_key_version: "encryptionkey@0"
I20260808 07:11:11.382951 28086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:11.402180 28086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:11.402608 28086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:11.402801 28086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:11.403105 28086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:11.403524 28086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:11.403586 28086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:11.403625 28086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:11.403658 28086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:11.412487 28086 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:37827
I20260808 07:11:11.412566 28217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:37827 every 8 connection(s)
I20260808 07:11:11.413043 28086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:11:11.420440 27926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.414209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:41195 (local address 127.9.94.62:38503)
0808 07:11:11.414349 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:11.414353 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:11.414379 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:11:11.415000 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:11.415002 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:11.415018 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:11.415138 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:11.416338 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.417046 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.418289 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.418546 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.418752 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.420099 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:11.420101 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:11.420102 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:11.420109 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:11.420132 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:11.420137 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:11.420199 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:11.420319 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 07:11:11.420354 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260808 07:11:11.420740 28220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.414012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:38503 (local address 127.9.94.2:41195)
0808 07:11:11.414225 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:11.414268 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:11.414791 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:11.415349 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:11.415355 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:11.415368 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:11.416078 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.416084 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.417185 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.417187 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.418113 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.418116 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.418781 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.418782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.418965 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.419738 (+ 773us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:11:11.419739 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:11.419772 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:11:11.419802 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:11.420221 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:11.420227 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:11.420229 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:11:11.420298 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 07:11:11.420398 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":100,"threads_started":1}
I20260808 07:11:11.421490 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 28086
I20260808 07:11:11.421514 28218 heartbeater.cc:347] Connected to a master server at 127.9.94.62:38503
I20260808 07:11:11.421630 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:11:11.421638 28218 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:11.421842 9592 external_mini_cluster.cc:1428] Setting key 1fcd00145387f3fa0085af62084c3752
I20260808 07:11:11.421840 28218 heartbeater.cc:511] Master 127.9.94.62:38503 requested a full tablet report, sending...
I20260808 07:11:11.422377 27882 ts_manager.cc:194] Registered new tserver with Master: 5d76879435454613b76697480b27a287 (127.9.94.2:37827)
I20260808 07:11:11.422900 27882 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.94.2:41195
I20260808 07:11:11.422984 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:38503
--builtin_ntp_servers=127.9.94.20:39069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:11:11.514637 28221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:11.514901 28221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:11.514938 28221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:11.516755 28221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:11.516853 28221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:11.516901 28221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:11:11.519069 28221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:39069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:38503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:11.519373 28221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:11.519721 28221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:11.525039 28229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:11.525226 28221 server_base.cc:1034] running on GCE node
W20260808 07:11:11.525029 28226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:11.525039 28227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:11.525579 28221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:11.525815 28221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:11.527011 28221 hybrid_clock.cc:648] HybridClock initialized: now 1786173071526999 us; error 32 us; skew 500 ppm
I20260808 07:11:11.528635 28221 webserver.cc:460] Webserver started at http://127.9.94.3:41679/ using document root <none> and password file <none>
I20260808 07:11:11.528951 28221 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:11.529013 28221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:11.529138 28221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:11.530308 28221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3"
format_stamp: "Formatted at 2026-08-08 07:11:11 on dist-test-slave-77v9"
server_key: "1a3005edffd20b55fe83f3f639010591"
server_key_iv: "43166fb621a541ebe10acd8154c42e60"
server_key_version: "encryptionkey@0"
I20260808 07:11:11.530678 28221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3"
format_stamp: "Formatted at 2026-08-08 07:11:11 on dist-test-slave-77v9"
server_key: "1a3005edffd20b55fe83f3f639010591"
server_key_iv: "43166fb621a541ebe10acd8154c42e60"
server_key_version: "encryptionkey@0"
I20260808 07:11:11.532194 28221 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:11:11.533273 28236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:11.533720 28221 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:11:11.533910 28221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3"
format_stamp: "Formatted at 2026-08-08 07:11:11 on dist-test-slave-77v9"
server_key: "1a3005edffd20b55fe83f3f639010591"
server_key_iv: "43166fb621a541ebe10acd8154c42e60"
server_key_version: "encryptionkey@0"
I20260808 07:11:11.534024 28221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:11.571332 28221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:11.571689 28221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:11.571822 28221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:11.572054 28221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:11.572463 28221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:11.572513 28221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:11.572540 28221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:11.572554 28221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:11.579831 28221 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:34001
I20260808 07:11:11.579901 28354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:34001 every 8 connection(s)
I20260808 07:11:11.580279 28221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:11:11.580595 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 28221
I20260808 07:11:11.580717 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:11:11.580947 9592 external_mini_cluster.cc:1428] Setting key 301a2fc7d5f8217fd4a9d9dc132b2fbb
I20260808 07:11:11.586382 27926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.581277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:49495 (local address 127.9.94.62:38503)
0808 07:11:11.581335 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:11.581339 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:11.581835 (+ 496us) server_negotiation.cc:407] Connection header received
0808 07:11:11.582339 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:11.582340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:11.582352 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:11.582398 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:11.583095 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.583602 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.584600 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.584868 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.584966 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.585974 (+ 1008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:11.585976 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:11.585977 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:11.585983 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:11.586031 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:11.586037 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:11.586094 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:11.586255 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 07:11:11.586286 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:11:11.586903 28357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.581304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:38503 (local address 127.9.94.3:49495)
0808 07:11:11.581563 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:11.581632 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:11.582235 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:11.582483 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:11.582487 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:11.582494 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:11.583002 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.583006 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.583710 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.583710 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.584505 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.584507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.584978 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.584979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.585113 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.585713 (+ 600us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:11:11.585713 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:11.585770 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:11:11.585799 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:11.586098 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:11.586155 (+ 57us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:11.586164 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 07:11:11.586257 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 07:11:11.586423 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":119,"threads_started":1}
I20260808 07:11:11.587858 28355 heartbeater.cc:347] Connected to a master server at 127.9.94.62:38503
I20260808 07:11:11.588048 28355 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:11.588341 28355 heartbeater.cc:511] Master 127.9.94.62:38503 requested a full tablet report, sending...
I20260808 07:11:11.588972 27882 ts_manager.cc:194] Registered new tserver with Master: 932b3b4dd7ea4432aabf1f86e2f0d0c3 (127.9.94.3:34001)
I20260808 07:11:11.589525 27882 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.94.3:49495
I20260808 07:11:11.593531 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:11:11.599218 27926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.595052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38314 (local address 127.9.94.62:38503)
0808 07:11:11.595197 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:11.595200 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:11.595254 (+ 54us) server_negotiation.cc:407] Connection header received
0808 07:11:11.595326 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:11.595327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:11.595342 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:11.595437 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:11.595665 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.596231 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.597418 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.597794 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.597934 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.598824 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:11.598826 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:11.598826 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:11.598831 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:11.598857 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:11.598861 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:11.598926 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:11.599124 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 07:11:11.599149 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260808 07:11:11.601625 27882 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38314:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:11:11.603304 27882 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:11:11.610982 28372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.606470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50436 (local address 127.9.94.3:34001)
0808 07:11:11.606723 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:11.606727 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:11.606736 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:11:11.606774 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:11.606782 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:11.606816 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:11.606925 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:11.607297 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.608387 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.609819 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.610495 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.610564 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.610658 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:11.610832 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 07:11:11.610877 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":118,"threads_started":1}
I20260808 07:11:11.610977 28369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.606008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:37827 (local address 127.0.0.1:56868)
0808 07:11:11.606189 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:11.606202 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:11.606277 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:11.607177 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:11.607178 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:11.607180 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:11.607217 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.607218 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.608591 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.608592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.609628 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.609630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.610599 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.610600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.610703 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.610722 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 07:11:11.610808 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 07:11:11.610881 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":14,"thread_start_us":95,"threads_started":1}
I20260808 07:11:11.610977 28370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.606231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:34001 (local address 127.0.0.1:50436)
0808 07:11:11.606488 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:11.606500 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:11.606551 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:11.606996 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:11.606997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:11.606999 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:11.607060 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.607061 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.608492 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.608493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.609743 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.609745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.610601 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.610601 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.610703 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.610722 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 07:11:11.610808 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 07:11:11.610881 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":30,"thread_start_us":83,"threads_started":1}
I20260808 07:11:11.611423 28373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.606507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56868 (local address 127.9.94.2:37827)
0808 07:11:11.607033 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:11.607037 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:11.607047 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:11:11.607083 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:11.607085 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:11.607099 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:11.607179 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:11.607278 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.608468 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.609721 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.610477 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.610564 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.610658 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:11.611118 (+ 460us) server_negotiation.cc:299] Negotiation successful
0808 07:11:11.611162 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":93,"threads_started":1}
I20260808 07:11:11.612059 28368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.605995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:46855 (local address 127.0.0.1:49728)
0808 07:11:11.606136 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:11.606184 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:11.606263 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:11.606661 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:11.606664 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:11.606667 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:11.606749 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.606751 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.608242 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.608243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.609743 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.609745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.611815 (+ 2070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.611816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.611875 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.611879 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:11:11.611972 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 07:11:11.612007 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":64,"thread_start_us":66,"threads_started":1}
I20260808 07:11:11.612126 28371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.606260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49728 (local address 127.9.94.1:46855)
0808 07:11:11.606433 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:11.606454 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:11.606466 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:11:11.606509 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:11.606511 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:11.606527 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:11.606648 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:11.606832 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.608067 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.610696 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.611437 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.611792 (+ 355us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.611895 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:11.611988 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 07:11:11.612038 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":101,"threads_started":1}
I20260808 07:11:11.612164 28270 tablet_service.cc:1467] Processing CreateTablet for tablet ec11b65ac3354d53b74a9f320206d6ec (DEFAULT_TABLE table=test-table [id=db0a849ff2974988b5125b2d4e8b9a67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:11.612567 28270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec11b65ac3354d53b74a9f320206d6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:11.612675 28014 tablet_service.cc:1467] Processing CreateTablet for tablet ec11b65ac3354d53b74a9f320206d6ec (DEFAULT_TABLE table=test-table [id=db0a849ff2974988b5125b2d4e8b9a67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:11.613030 28014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec11b65ac3354d53b74a9f320206d6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:11.613224 28151 tablet_service.cc:1467] Processing CreateTablet for tablet ec11b65ac3354d53b74a9f320206d6ec (DEFAULT_TABLE table=test-table [id=db0a849ff2974988b5125b2d4e8b9a67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:11.613547 28151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec11b65ac3354d53b74a9f320206d6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:11.615783 28374 tablet_bootstrap.cc:492] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8: Bootstrap starting.
I20260808 07:11:11.616387 28375 tablet_bootstrap.cc:492] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3: Bootstrap starting.
I20260808 07:11:11.616736 28376 tablet_bootstrap.cc:492] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287: Bootstrap starting.
I20260808 07:11:11.616987 28374 tablet_bootstrap.cc:654] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:11.617197 28375 tablet_bootstrap.cc:654] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:11.617421 28374 log.cc:824] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:11.617564 28375 log.cc:824] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:11.617820 28376 tablet_bootstrap.cc:654] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:11.618175 28376 log.cc:824] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:11.618957 28376 tablet_bootstrap.cc:492] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287: No bootstrap required, opened a new log
I20260808 07:11:11.618947 28374 tablet_bootstrap.cc:492] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8: No bootstrap required, opened a new log
I20260808 07:11:11.618986 28375 tablet_bootstrap.cc:492] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3: No bootstrap required, opened a new log
I20260808 07:11:11.619050 28375 ts_tablet_manager.cc:1397] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:11:11.619048 28376 ts_tablet_manager.cc:1397] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:11:11.619050 28374 ts_tablet_manager.cc:1397] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260808 07:11:11.620985 28376 raft_consensus.cc:348] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d76879435454613b76697480b27a287" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37827 } } peers { permanent_uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34001 } } peers { permanent_uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 46855 } }
I20260808 07:11:11.621152 28376 raft_consensus.cc:374] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:11.621196 28376 raft_consensus.cc:729] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d76879435454613b76697480b27a287, State: Initialized, Role: FOLLOWER
I20260808 07:11:11.621344 28376 consensus_queue.cc:260] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d76879435454613b76697480b27a287" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37827 } } peers { permanent_uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34001 } } peers { permanent_uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 46855 } }
I20260808 07:11:11.621665 28218 heartbeater.cc:503] Master 127.9.94.62:38503 was elected leader, sending a full tablet report...
I20260808 07:11:11.621649 28376 ts_tablet_manager.cc:1428] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:11:11.621786 28374 raft_consensus.cc:348] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d76879435454613b76697480b27a287" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37827 } } peers { permanent_uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34001 } } peers { permanent_uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 46855 } }
I20260808 07:11:11.621786 28375 raft_consensus.cc:348] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d76879435454613b76697480b27a287" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37827 } } peers { permanent_uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34001 } } peers { permanent_uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 46855 } }
I20260808 07:11:11.621937 28374 raft_consensus.cc:374] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:11.621948 28375 raft_consensus.cc:374] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:11.621984 28375 raft_consensus.cc:729] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932b3b4dd7ea4432aabf1f86e2f0d0c3, State: Initialized, Role: FOLLOWER
I20260808 07:11:11.621979 28374 raft_consensus.cc:729] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49dcca7d73f45a8b3fc6ac60e2778e8, State: Initialized, Role: FOLLOWER
I20260808 07:11:11.622133 28374 consensus_queue.cc:260] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d76879435454613b76697480b27a287" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37827 } } peers { permanent_uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34001 } } peers { permanent_uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 46855 } }
I20260808 07:11:11.622128 28375 consensus_queue.cc:260] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d76879435454613b76697480b27a287" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37827 } } peers { permanent_uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34001 } } peers { permanent_uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 46855 } }
I20260808 07:11:11.622395 28375 ts_tablet_manager.cc:1428] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 07:11:11.622395 28374 ts_tablet_manager.cc:1428] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8: Time spent starting tablet: real 0.003s user 0.002s sys 0.002s
I20260808 07:11:11.622510 28355 heartbeater.cc:503] Master 127.9.94.62:38503 was elected leader, sending a full tablet report...
I20260808 07:11:11.622510 28083 heartbeater.cc:503] Master 127.9.94.62:38503 was elected leader, sending a full tablet report...
I20260808 07:11:11.626609 28380 raft_consensus.cc:482] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:11:11.626708 28380 raft_consensus.cc:504] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d76879435454613b76697480b27a287" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37827 } } peers { permanent_uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34001 } } peers { permanent_uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 46855 } }
I20260808 07:11:11.627144 28380 leader_election.cc:288] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932b3b4dd7ea4432aabf1f86e2f0d0c3 (127.9.94.3:34001), e49dcca7d73f45a8b3fc6ac60e2778e8 (127.9.94.1:46855)
I20260808 07:11:11.631088 28371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.627430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:45303 (local address 127.9.94.1:46855)
0808 07:11:11.627519 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:11.627522 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:11.627530 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:11:11.627570 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:11.627571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:11.627585 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:11.627644 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:11.627827 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.628683 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.630152 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.630711 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.630787 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.630797 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:11.630963 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 07:11:11.631022 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 07:11:11.631114 28372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.627711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:34339 (local address 127.9.94.3:34001)
0808 07:11:11.627807 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:11.627809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:11.627836 (+ 27us) server_negotiation.cc:407] Connection header received
0808 07:11:11.627909 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:11.627910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:11.627919 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:11.627984 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:11.628138 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.628869 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.630169 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.630710 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.630787 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.630797 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:11.631012 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 07:11:11.631050 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 07:11:11.631102 28220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.627303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:46855 (local address 127.9.94.2:45303)
0808 07:11:11.627445 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:11.627459 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:11.627504 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:11.627659 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:11.627660 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:11.627661 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:11.627738 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.627741 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.628762 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.628763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.630039 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.630042 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.630799 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.630800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.630886 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.630890 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:11:11.630950 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 07:11:11.631009 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":3}
I20260808 07:11:11.631110 28383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.627315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:34001 (local address 127.9.94.2:34339)
0808 07:11:11.627785 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:11.627795 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:11.627852 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:11.628001 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:11.628002 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:11.628003 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:11.628062 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.628063 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.628962 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.628962 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.630084 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:11.630086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.630800 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.630801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:11.630935 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.630939 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:11:11.630991 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 07:11:11.631021 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":126,"threads_started":1}
I20260808 07:11:11.631502 28034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec11b65ac3354d53b74a9f320206d6ec" candidate_uuid: "5d76879435454613b76697480b27a287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8" is_pre_election: true
I20260808 07:11:11.631538 28306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec11b65ac3354d53b74a9f320206d6ec" candidate_uuid: "5d76879435454613b76697480b27a287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3" is_pre_election: true
I20260808 07:11:11.631668 28306 raft_consensus.cc:2454] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d76879435454613b76697480b27a287 in term 0.
I20260808 07:11:11.631668 28034 raft_consensus.cc:2454] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d76879435454613b76697480b27a287 in term 0.
I20260808 07:11:11.631897 28105 leader_election.cc:302] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d76879435454613b76697480b27a287, 932b3b4dd7ea4432aabf1f86e2f0d0c3; no voters:
I20260808 07:11:11.632073 28380 raft_consensus.cc:2781] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:11:11.632149 28380 raft_consensus.cc:482] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:11:11.632180 28380 raft_consensus.cc:3037] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:11.633011 28380 raft_consensus.cc:504] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d76879435454613b76697480b27a287" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37827 } } peers { permanent_uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34001 } } peers { permanent_uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 46855 } }
I20260808 07:11:11.633170 28380 leader_election.cc:288] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [CANDIDATE]: Term 1 election: Requested vote from peers 932b3b4dd7ea4432aabf1f86e2f0d0c3 (127.9.94.3:34001), e49dcca7d73f45a8b3fc6ac60e2778e8 (127.9.94.1:46855)
I20260808 07:11:11.633322 28306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec11b65ac3354d53b74a9f320206d6ec" candidate_uuid: "5d76879435454613b76697480b27a287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3"
I20260808 07:11:11.633342 28034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec11b65ac3354d53b74a9f320206d6ec" candidate_uuid: "5d76879435454613b76697480b27a287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8"
I20260808 07:11:11.633399 28306 raft_consensus.cc:3037] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:11.633433 28034 raft_consensus.cc:3037] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:11.634339 28306 raft_consensus.cc:2454] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d76879435454613b76697480b27a287 in term 1.
I20260808 07:11:11.634488 28034 raft_consensus.cc:2454] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d76879435454613b76697480b27a287 in term 1.
I20260808 07:11:11.634503 28105 leader_election.cc:302] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d76879435454613b76697480b27a287, 932b3b4dd7ea4432aabf1f86e2f0d0c3; no voters:
I20260808 07:11:11.634610 28380 raft_consensus.cc:2781] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:11.634814 28380 raft_consensus.cc:686] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [term 1 LEADER]: Becoming Leader. State: Replica: 5d76879435454613b76697480b27a287, State: Running, Role: LEADER
I20260808 07:11:11.634927 28380 consensus_queue.cc:237] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d76879435454613b76697480b27a287" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37827 } } peers { permanent_uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34001 } } peers { permanent_uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 46855 } }
I20260808 07:11:11.635907 27881 catalog_manager.cc:5495] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d76879435454613b76697480b27a287 (127.9.94.2). New cstate: current_term: 1 leader_uuid: "5d76879435454613b76697480b27a287" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d76879435454613b76697480b27a287" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 37827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 46855 } health_report { overall_health: UNKNOWN } } }
I20260808 07:11:11.648036 28373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.645101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56884 (local address 127.9.94.2:37827)
0808 07:11:11.645243 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:11.645247 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:11.645290 (+ 43us) server_negotiation.cc:407] Connection header received
0808 07:11:11.645399 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:11.645405 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:11.645428 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:11.645522 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:11.645695 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.646176 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.647011 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:11.647219 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:11.647310 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:11.647611 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:11.647733 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:11.647836 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:11.647882 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 07:11:11.647906 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260808 07:11:11.650208 28306 raft_consensus.cc:1261] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3 [term 1 FOLLOWER]: Refusing update from remote peer 5d76879435454613b76697480b27a287: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:11.650203 28034 raft_consensus.cc:1261] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8 [term 1 FOLLOWER]: Refusing update from remote peer 5d76879435454613b76697480b27a287: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:11.650697 28380 consensus_queue.cc:1035] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e49dcca7d73f45a8b3fc6ac60e2778e8" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 46855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:11.650858 28384 consensus_queue.cc:1035] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932b3b4dd7ea4432aabf1f86e2f0d0c3" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 34001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:11.654096 28389 mvcc.cc:205] Tried to move back new op lower bound from 7316164901476261888 to 7316164901417459712. Current Snapshot: MvccSnapshot[applied={T|T < 7316164901476261888}]
I20260808 07:11:11.654608 28390 mvcc.cc:205] Tried to move back new op lower bound from 7316164901476261888 to 7316164901417459712. Current Snapshot: MvccSnapshot[applied={T|T < 7316164901476261888}]
I20260808 07:11:11.657162 27881 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:11:11.657263 27881 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:11:11.658255 27881 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 08e10d4c3d3a49a9805d30b87bda5027: Sending DeleteTablet for 3 replicas of tablet ec11b65ac3354d53b74a9f320206d6ec
I20260808 07:11:11.658658 28270 tablet_service.cc:1514] Processing DeleteTablet for tablet ec11b65ac3354d53b74a9f320206d6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:11 UTC) from {username='slave'} at 127.0.0.1:50436
I20260808 07:11:11.658674 28151 tablet_service.cc:1514] Processing DeleteTablet for tablet ec11b65ac3354d53b74a9f320206d6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:11 UTC) from {username='slave'} at 127.0.0.1:56868
I20260808 07:11:11.658730 28014 tablet_service.cc:1514] Processing DeleteTablet for tablet ec11b65ac3354d53b74a9f320206d6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:11 UTC) from {username='slave'} at 127.0.0.1:49728
I20260808 07:11:11.658913 28399 tablet_replica.cc:330] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287: stopping tablet replica
I20260808 07:11:11.659022 28402 tablet_replica.cc:330] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8: stopping tablet replica
I20260808 07:11:11.659035 28399 raft_consensus.cc:2229] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:11:11.659124 28402 raft_consensus.cc:2229] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:11:11.659164 28399 raft_consensus.cc:2258] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:11.659214 28402 raft_consensus.cc:2258] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:11.659405 28401 tablet_replica.cc:330] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3: stopping tablet replica
I20260808 07:11:11.659511 28401 raft_consensus.cc:2229] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:11:11.659610 28401 raft_consensus.cc:2258] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:11.659678 28402 ts_tablet_manager.cc:1905] T ec11b65ac3354d53b74a9f320206d6ec P e49dcca7d73f45a8b3fc6ac60e2778e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:11:11.659689 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 27947
I20260808 07:11:11.660163 28401 ts_tablet_manager.cc:1905] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:11:11.661830 28399 ts_tablet_manager.cc:1905] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:11:11.662081 28401 ts_tablet_manager.cc:1918] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:11:11.662149 28401 log.cc:1196] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/ec11b65ac3354d53b74a9f320206d6ec
I20260808 07:11:11.662444 28401 ts_tablet_manager.cc:1939] T ec11b65ac3354d53b74a9f320206d6ec P 932b3b4dd7ea4432aabf1f86e2f0d0c3: Deleting consensus metadata
I20260808 07:11:11.662863 27869 catalog_manager.cc:4841] TS 932b3b4dd7ea4432aabf1f86e2f0d0c3 (127.9.94.3:34001): tablet ec11b65ac3354d53b74a9f320206d6ec (table test-table [id=db0a849ff2974988b5125b2d4e8b9a67]) successfully deleted
I20260808 07:11:11.663862 28399 ts_tablet_manager.cc:1918] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:11:11.663981 28399 log.cc:1196] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/ec11b65ac3354d53b74a9f320206d6ec
I20260808 07:11:11.664224 28399 ts_tablet_manager.cc:1939] T ec11b65ac3354d53b74a9f320206d6ec P 5d76879435454613b76697480b27a287: Deleting consensus metadata
I20260808 07:11:11.664577 27869 catalog_manager.cc:4841] TS 5d76879435454613b76697480b27a287 (127.9.94.2:37827): tablet ec11b65ac3354d53b74a9f320206d6ec (table test-table [id=db0a849ff2974988b5125b2d4e8b9a67]) successfully deleted
W20260808 07:11:11.668691 27868 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:46855 (error 108)
I20260808 07:11:11.668938 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 28086
I20260808 07:11:11.670300 28368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:11.670122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:46855 (local address 127.0.0.1:49740)
0808 07:11:11.670191 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:11.670255 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:46855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 07:11:11.670473 27868 catalog_manager.cc:4584] TS e49dcca7d73f45a8b3fc6ac60e2778e8 (127.9.94.1:46855): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ec11b65ac3354d53b74a9f320206d6ec: Network error: Client connection negotiation failed: client connection to 127.9.94.1:46855: connect: Connection refused (error 111)
I20260808 07:11:11.675076 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 28221
I20260808 07:11:11.681423 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 27851
2026-08-08T07:11:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (829 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:11 dist-test-slave-77v9 krb5kdc[28406](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:11 dist-test-slave-77v9 krb5kdc[28406](info): set up 2 sockets
Aug 08 07:11:11 dist-test-slave-77v9 krb5kdc[28406](info): commencing operation
krb5kdc: starting...
W20260808 07:11:12.850762 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:12 dist-test-slave-77v9 krb5kdc[28406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:11:12.998651 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:34107
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:34107
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:13.102957 28419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:13.103237 28419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:13.103278 28419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:13.105418 28419 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:13.105535 28419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:13.105566 28419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:13.105587 28419 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:13.105619 28419 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:13.107404 28419 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:34107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:34107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:13.107718 28419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:13.107986 28419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:13.113595 28428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:13.113587 28424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:13.113587 28426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:13.113628 28419 server_base.cc:1034] running on GCE node
I20260808 07:11:13.114168 28419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:13.114523 28419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:13.115698 28419 hybrid_clock.cc:648] HybridClock initialized: now 1786173073115688 us; error 38 us; skew 500 ppm
Aug 08 07:11:13 dist-test-slave-77v9 krb5kdc[28406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173073, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:13.119707 28419 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:11:13.120258 28419 webserver.cc:460] Webserver started at http://127.9.94.62:35975/ using document root <none> and password file <none>
I20260808 07:11:13.120536 28419 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:13.120587 28419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:13.120710 28419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:13.121896 28419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "43f65293a5b74ed1b858988c831f244a"
format_stamp: "Formatted at 2026-08-08 07:11:13 on dist-test-slave-77v9"
server_key: "be29cee92b97458b591c5b45a97b9dca"
server_key_iv: "26c723e13c1b1b8db0312c0c5898ce42"
server_key_version: "encryptionkey@0"
I20260808 07:11:13.122287 28419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "43f65293a5b74ed1b858988c831f244a"
format_stamp: "Formatted at 2026-08-08 07:11:13 on dist-test-slave-77v9"
server_key: "be29cee92b97458b591c5b45a97b9dca"
server_key_iv: "26c723e13c1b1b8db0312c0c5898ce42"
server_key_version: "encryptionkey@0"
I20260808 07:11:13.123927 28419 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:11:13.125466 28435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:13.125969 28419 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:11:13.126133 28419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "43f65293a5b74ed1b858988c831f244a"
format_stamp: "Formatted at 2026-08-08 07:11:13 on dist-test-slave-77v9"
server_key: "be29cee92b97458b591c5b45a97b9dca"
server_key_iv: "26c723e13c1b1b8db0312c0c5898ce42"
server_key_version: "encryptionkey@0"
I20260808 07:11:13.126230 28419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:13.138597 28419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:13.141103 28419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:13.141314 28419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:13.145433 28419 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:34107
I20260808 07:11:13.145469 28488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:34107 every 8 connection(s)
I20260808 07:11:13.145877 28419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:13.146853 28489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:13.149451 28489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a: Bootstrap starting.
I20260808 07:11:13.150107 28489 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:13.150421 28489 log.cc:824] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:13.151278 28489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a: No bootstrap required, opened a new log
I20260808 07:11:13.153112 28489 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f65293a5b74ed1b858988c831f244a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34107 } }
I20260808 07:11:13.153263 28489 raft_consensus.cc:374] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:13.153286 28489 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43f65293a5b74ed1b858988c831f244a, State: Initialized, Role: FOLLOWER
I20260808 07:11:13.153530 28489 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f65293a5b74ed1b858988c831f244a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34107 } }
I20260808 07:11:13.153836 28489 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:13.153877 28489 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:13.153962 28489 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:13.154762 28489 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f65293a5b74ed1b858988c831f244a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34107 } }
I20260808 07:11:13.154876 28489 leader_election.cc:302] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43f65293a5b74ed1b858988c831f244a; no voters:
I20260808 07:11:13.155121 28489 leader_election.cc:288] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:13.155195 28492 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:13.155433 28489 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:13.155433 28492 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [term 1 LEADER]: Becoming Leader. State: Replica: 43f65293a5b74ed1b858988c831f244a, State: Running, Role: LEADER
I20260808 07:11:13.155697 28492 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f65293a5b74ed1b858988c831f244a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34107 } }
I20260808 07:11:13.155925 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 28419
I20260808 07:11:13.156044 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:13.156291 9592 external_mini_cluster.cc:1428] Setting key 9403e4c301bd6fa17336716f8351b7e0
I20260808 07:11:13.156354 28494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43f65293a5b74ed1b858988c831f244a. Latest consensus state: current_term: 1 leader_uuid: "43f65293a5b74ed1b858988c831f244a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f65293a5b74ed1b858988c831f244a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34107 } } }
I20260808 07:11:13.156440 28494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:13.156805 28493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43f65293a5b74ed1b858988c831f244a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f65293a5b74ed1b858988c831f244a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34107 } } }
I20260808 07:11:13.156937 28493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a [sys.catalog]: This master's current role is: LEADER
W20260808 07:11:13.158481 28510 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:11:13.158555 28510 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:11:13.158653 28502 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:13.158900 28502 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:13.160781 28502 catalog_manager.cc:1347] Generated new cluster ID: 90f254f8b8684d8bb2c928a63c2ef292
I20260808 07:11:13.160920 28502 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:11:13 dist-test-slave-77v9 krb5kdc[28406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:13.172300 28509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:13.156934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57214 (local address 127.9.94.62:34107)
0808 07:11:13.157123 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:13.157133 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:13.157298 (+ 165us) server_negotiation.cc:407] Connection header received
0808 07:11:13.157433 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:13.157440 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:13.157513 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:13.157664 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:13.158430 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.159615 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.160806 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.161593 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.161817 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:13.168359 (+ 6542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:13.168367 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:13.168368 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:13.168389 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:13.170458 (+ 2069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:13.170916 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:13.170920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:13.170920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:13.171039 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:13.171294 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:13.171295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:13.171296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:13.171582 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:13.171781 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:13.171915 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 07:11:13.172080 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":84,"threads_started":1}
I20260808 07:11:13.200235 28502 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:13.200801 28502 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:13.203622 28502 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a: Generated new TSK 0
I20260808 07:11:13.203825 28502 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:11:13.249856 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:34107
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:13.353660 28516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:13.353888 28516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:13.353922 28516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:13.355041 28516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:13.355080 28516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:13.355108 28516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:11:13.356766 28516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:34107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:13.357018 28516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:13.357226 28516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:13.362753 28524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:13.362753 28522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:13.362756 28521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:13.363093 28516 server_base.cc:1034] running on GCE node
I20260808 07:11:13.363333 28516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:13.363684 28516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:13.365064 28516 hybrid_clock.cc:648] HybridClock initialized: now 1786173073365021 us; error 59 us; skew 500 ppm
Aug 08 07:11:13 dist-test-slave-77v9 krb5kdc[28406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173073, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:13.368062 28516 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:11:13.368542 28516 webserver.cc:460] Webserver started at http://127.9.94.1:40561/ using document root <none> and password file <none>
I20260808 07:11:13.368887 28516 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:13.368974 28516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:13.369154 28516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:13.370433 28516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "af61174127594db582cc1a2c3e5a9e26"
format_stamp: "Formatted at 2026-08-08 07:11:13 on dist-test-slave-77v9"
server_key: "5820582424fcb64c00f36fbdf8707cda"
server_key_iv: "58b836499bdc80ec66461d7b57c41ebb"
server_key_version: "encryptionkey@0"
I20260808 07:11:13.370904 28516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "af61174127594db582cc1a2c3e5a9e26"
format_stamp: "Formatted at 2026-08-08 07:11:13 on dist-test-slave-77v9"
server_key: "5820582424fcb64c00f36fbdf8707cda"
server_key_iv: "58b836499bdc80ec66461d7b57c41ebb"
server_key_version: "encryptionkey@0"
I20260808 07:11:13.372634 28516 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:11:13.373672 28532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:13.373888 28516 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:13.374040 28516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "af61174127594db582cc1a2c3e5a9e26"
format_stamp: "Formatted at 2026-08-08 07:11:13 on dist-test-slave-77v9"
server_key: "5820582424fcb64c00f36fbdf8707cda"
server_key_iv: "58b836499bdc80ec66461d7b57c41ebb"
server_key_version: "encryptionkey@0"
I20260808 07:11:13.374140 28516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:13.384132 28516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:13.386593 28516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:13.386771 28516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:13.387017 28516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:13.387578 28516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:13.387674 28516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:13.387729 28516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:13.387777 28516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:13.395264 28516 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:43737
I20260808 07:11:13.395347 28653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:43737 every 8 connection(s)
I20260808 07:11:13.396008 28516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:11:13.397680 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 28516
I20260808 07:11:13.397809 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:11:13.398049 9592 external_mini_cluster.cc:1428] Setting key 720a720e0ed69c662ad94597d25a56f0
Aug 08 07:11:13 dist-test-slave-77v9 krb5kdc[28406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173073, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
I20260808 07:11:13.411242 28657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:13.396914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:34107 (local address 127.9.94.1:45471)
0808 07:11:13.397120 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:13.397164 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:13.398106 (+ 942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:13.398552 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:13.398557 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:13.399338 (+ 781us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:13.399548 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:13.399553 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.400614 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.400615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:13.402489 (+ 1874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:13.402493 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.403207 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.403208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:13.403340 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:13.403989 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:13.404019 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:13.406012 (+ 1993us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:13.408543 (+ 2531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:13.408574 (+ 31us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:13.408578 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:13.409348 (+ 770us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:13.409697 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:13.409698 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:13.409699 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:13.409905 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:13.410490 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:13.410500 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:13.410676 (+ 176us) client_negotiation.cc:769] Sending connection context
0808 07:11:13.410784 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 07:11:13.411027 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":81,"threads_started":1}
I20260808 07:11:13.411422 28509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:13.397130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:45471 (local address 127.9.94.62:34107)
0808 07:11:13.397178 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:13.397181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:13.397301 (+ 120us) server_negotiation.cc:407] Connection header received
0808 07:11:13.398316 (+ 1015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:13.398318 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:13.398341 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:13.398419 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:13.399660 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.400481 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.402621 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.403057 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.403163 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:13.406138 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:13.406140 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:13.406141 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:13.406151 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:13.408361 (+ 2210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:13.409477 (+ 1116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:13.409479 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:13.409479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:13.409553 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:13.410141 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:13.410143 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:13.410143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:13.410343 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:13.410428 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:13.410869 (+ 441us) server_negotiation.cc:299] Negotiation successful
0808 07:11:13.410976 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:11:13.412252 28655 heartbeater.cc:347] Connected to a master server at 127.9.94.62:34107
I20260808 07:11:13.412405 28655 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:13.412636 28655 heartbeater.cc:511] Master 127.9.94.62:34107 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
I20260808 07:11:13.413519 28452 ts_manager.cc:194] Registered new tserver with Master: af61174127594db582cc1a2c3e5a9e26 (127.9.94.1:43737)
I20260808 07:11:13.414186 28452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:45471
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:11:13.433014 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:34107
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:13.533094 28660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:13.533329 28660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:13.533356 28660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:13.534611 28660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:13.534669 28660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:13.534699 28660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:11:13.536414 28660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:34107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:13.536695 28660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:13.537019 28660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:13.543286 28667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:13.543308 28670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:13.543497 28660 server_base.cc:1034] running on GCE node
W20260808 07:11:13.543262 28666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:13.543766 28660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:13.544028 28660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:13.545212 28660 hybrid_clock.cc:648] HybridClock initialized: now 1786173073545197 us; error 52 us; skew 500 ppm
Aug 08 07:11:13 dist-test-slave-77v9 krb5kdc[28406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173073, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:13.547885 28660 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:11:13.548339 28660 webserver.cc:460] Webserver started at http://127.9.94.2:34799/ using document root <none> and password file <none>
I20260808 07:11:13.548533 28660 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:13.548574 28660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:13.548668 28660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:13.549868 28660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d"
format_stamp: "Formatted at 2026-08-08 07:11:13 on dist-test-slave-77v9"
server_key: "1e449fa5c30a06a267e3563b7670774f"
server_key_iv: "c673764f43835df35de1c0be01ca683c"
server_key_version: "encryptionkey@0"
I20260808 07:11:13.550217 28660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d"
format_stamp: "Formatted at 2026-08-08 07:11:13 on dist-test-slave-77v9"
server_key: "1e449fa5c30a06a267e3563b7670774f"
server_key_iv: "c673764f43835df35de1c0be01ca683c"
server_key_version: "encryptionkey@0"
I20260808 07:11:13.551783 28660 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:11:13.552668 28677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:13.553064 28660 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:13.553157 28660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d"
format_stamp: "Formatted at 2026-08-08 07:11:13 on dist-test-slave-77v9"
server_key: "1e449fa5c30a06a267e3563b7670774f"
server_key_iv: "c673764f43835df35de1c0be01ca683c"
server_key_version: "encryptionkey@0"
I20260808 07:11:13.553217 28660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:13.562506 28660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:13.565637 28660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:13.565850 28660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:13.566082 28660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:13.566371 28660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:13.566406 28660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:13.566428 28660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:13.566457 28660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:13.574424 28660 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:34517
I20260808 07:11:13.574470 28805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:34517 every 8 connection(s)
I20260808 07:11:13.574813 28660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:11:13.581287 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 28660
I20260808 07:11:13.581458 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:11:13.581668 9592 external_mini_cluster.cc:1428] Setting key 346eb58fe9202c884dc97c115c5a5d65
Aug 08 07:11:13 dist-test-slave-77v9 krb5kdc[28406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173073, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:13.585618 28509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:13.575713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:49891 (local address 127.9.94.62:34107)
0808 07:11:13.575814 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:13.575816 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:13.576047 (+ 231us) server_negotiation.cc:407] Connection header received
0808 07:11:13.576632 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:13.576633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:13.576647 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:13.576689 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:13.577823 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.578342 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.579481 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.579696 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.579785 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:13.582528 (+ 2743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:13.582530 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:13.582530 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:13.582540 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:13.583925 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:13.584462 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:13.584463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:13.584464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:13.584530 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:13.584799 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:13.584800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:13.584801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:13.584970 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:13.585095 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:13.585421 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 07:11:13.585521 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 07:11:13.585778 28808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:13.575584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:34107 (local address 127.9.94.2:49891)
0808 07:11:13.575856 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:13.575953 (+ 97us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:13.576509 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:13.576775 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:13.576778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:13.577452 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:13.577726 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:13.577731 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.578451 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.578452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:13.579397 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:13.579400 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.579799 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.579801 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:13.579932 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:13.580499 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:13.580508 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:13.582422 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:13.584130 (+ 1708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:13.584137 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:13.584140 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:13.584380 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:13.584614 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:13.584614 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:13.584615 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:13.584730 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:13.585087 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:13.585095 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:13.585245 (+ 150us) client_negotiation.cc:769] Sending connection context
0808 07:11:13.585354 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 07:11:13.585538 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":130,"threads_started":1}
I20260808 07:11:13.586514 28806 heartbeater.cc:347] Connected to a master server at 127.9.94.62:34107
I20260808 07:11:13.586650 28806 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:13.586860 28806 heartbeater.cc:511] Master 127.9.94.62:34107 requested a full tablet report, sending...
I20260808 07:11:13.587360 28452 ts_manager.cc:194] Registered new tserver with Master: f6ea1c0a01fa45c583ae1fdb58c0ea3d (127.9.94.2:34517)
I20260808 07:11:13.587808 28452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:49891
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:11:13.617674 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:34107
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:13.709026 28811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:13.709256 28811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:13.709285 28811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:13.710609 28811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:13.710656 28811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:13.710685 28811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:11:13.712230 28811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:34107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:13.712440 28811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:13.712630 28811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:13.718531 28816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:13.718567 28819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:13.718739 28817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:13.718653 28811 server_base.cc:1034] running on GCE node
I20260808 07:11:13.719082 28811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:13.719362 28811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:13.720546 28811 hybrid_clock.cc:648] HybridClock initialized: now 1786173073720521 us; error 43 us; skew 500 ppm
Aug 08 07:11:13 dist-test-slave-77v9 krb5kdc[28406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173073, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:13.723521 28811 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:11:13.724078 28811 webserver.cc:460] Webserver started at http://127.9.94.3:42869/ using document root <none> and password file <none>
I20260808 07:11:13.724349 28811 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:13.724421 28811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:13.724586 28811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:13.725782 28811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "85b73da659ff4de7947d33ed48075a7f"
format_stamp: "Formatted at 2026-08-08 07:11:13 on dist-test-slave-77v9"
server_key: "25499c832035930f865078ef20007132"
server_key_iv: "3af8389f31fd1279dff9ff01ea71e0a1"
server_key_version: "encryptionkey@0"
I20260808 07:11:13.726171 28811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "85b73da659ff4de7947d33ed48075a7f"
format_stamp: "Formatted at 2026-08-08 07:11:13 on dist-test-slave-77v9"
server_key: "25499c832035930f865078ef20007132"
server_key_iv: "3af8389f31fd1279dff9ff01ea71e0a1"
server_key_version: "encryptionkey@0"
I20260808 07:11:13.727608 28811 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:11:13.728453 28826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:13.728673 28811 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:13.728853 28811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "85b73da659ff4de7947d33ed48075a7f"
format_stamp: "Formatted at 2026-08-08 07:11:13 on dist-test-slave-77v9"
server_key: "25499c832035930f865078ef20007132"
server_key_iv: "3af8389f31fd1279dff9ff01ea71e0a1"
server_key_version: "encryptionkey@0"
I20260808 07:11:13.728991 28811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:13.743460 28811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:13.746137 28811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:13.746320 28811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:13.746593 28811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:13.746935 28811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:13.746995 28811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:13.747037 28811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:13.747071 28811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:13.753868 28811 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:45043
I20260808 07:11:13.753932 28948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:45043 every 8 connection(s)
I20260808 07:11:13.754299 28811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:11:13 dist-test-slave-77v9 krb5kdc[28406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173073, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:13.764549 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 28811
I20260808 07:11:13.764688 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:11:13.764988 9592 external_mini_cluster.cc:1428] Setting key 0f63b6a90a1fb925ac7a52c50a2a5b18
I20260808 07:11:13.766361 28509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:13.755222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:55317 (local address 127.9.94.62:34107)
0808 07:11:13.755298 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:13.755300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:13.755534 (+ 234us) server_negotiation.cc:407] Connection header received
0808 07:11:13.756304 (+ 770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:13.756306 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:13.756319 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:13.756387 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:13.758052 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.758589 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.759727 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.760007 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.760070 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:13.762687 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:13.762689 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:13.762689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:13.762696 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:13.764187 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:13.764800 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:13.764801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:13.764801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:13.764926 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:13.765328 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:13.765329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:13.765329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:13.765514 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:13.765590 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:13.766134 (+ 544us) server_negotiation.cc:299] Negotiation successful
0808 07:11:13.766244 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 07:11:13.766644 28951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:13.755189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:34107 (local address 127.9.94.3:55317)
0808 07:11:13.755402 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:13.755440 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:13.756149 (+ 709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:13.756509 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:13.756513 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:13.757692 (+ 1179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:13.757939 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:13.757947 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.758759 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.758760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:13.759572 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:13.759574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.760124 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.760125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:13.760238 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:13.760913 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:13.760922 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:13.762579 (+ 1657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:13.764301 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:13.764309 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:13.764333 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:13.764607 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:13.765010 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:13.765011 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:13.765012 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:13.765212 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:13.765729 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:13.765737 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:13.765955 (+ 218us) client_negotiation.cc:769] Sending connection context
0808 07:11:13.766108 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 07:11:13.766326 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":118,"threads_started":1}
I20260808 07:11:13.767218 28949 heartbeater.cc:347] Connected to a master server at 127.9.94.62:34107
I20260808 07:11:13.767333 28949 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:13.767544 28949 heartbeater.cc:511] Master 127.9.94.62:34107 requested a full tablet report, sending...
I20260808 07:11:13.768100 28452 ts_manager.cc:194] Registered new tserver with Master: 85b73da659ff4de7947d33ed48075a7f (127.9.94.3:45043)
I20260808 07:11:13.768529 28452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:55317
I20260808 07:11:13.778003 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:11:13.788146 28509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:13.779689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57230 (local address 127.9.94.62:34107)
0808 07:11:13.779743 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:13.779745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:13.779928 (+ 183us) server_negotiation.cc:407] Connection header received
0808 07:11:13.779968 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:13.779969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:13.779981 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:13.780059 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:13.780862 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.781527 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.782310 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.782523 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.782594 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:13.784259 (+ 1665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:13.784261 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:13.784261 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:13.784274 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:13.786085 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:13.786732 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:13.786735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:13.786735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:13.786884 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:13.787279 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:13.787281 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:13.787281 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:13.787492 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:13.787614 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:13.787943 (+ 329us) server_negotiation.cc:299] Negotiation successful
0808 07:11:13.788025 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:11:13.790397 28452 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57230:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:11:13.792068 28452 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:11:13.799465 28964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:13.795212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38340 (local address 127.9.94.3:45043)
0808 07:11:13.795557 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:13.795561 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:13.795570 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:11:13.795608 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:13.795610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:13.795625 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:13.795839 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:13.796060 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.796892 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.798391 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.799032 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.799126 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:13.799191 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:13.799322 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 07:11:13.799365 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":131,"threads_started":1}
I20260808 07:11:13.799453 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:13.795034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:45043 (local address 127.0.0.1:38340)
0808 07:11:13.795237 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:13.795281 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:13.795354 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:13.795931 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:13.795932 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:13.795934 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:13.795997 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:13.795999 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.797046 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.797047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:13.798290 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:13.798293 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.799127 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.799128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:13.799213 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:13.799226 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 07:11:13.799302 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 07:11:13.799365 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":53,"threads_started":1}
I20260808 07:11:13.799948 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:13.795034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:43737 (local address 127.0.0.1:56354)
0808 07:11:13.795413 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:13.795425 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:13.795482 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:13.795736 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:13.795739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:13.795741 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:13.795826 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:13.795829 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.797542 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.797543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:13.798629 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:13.798632 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.799624 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.799626 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:13.799709 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:13.799712 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:11:13.799766 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 07:11:13.799823 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":106,"thread_start_us":93,"threads_started":1}
I20260808 07:11:13.799947 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:13.795042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:34517 (local address 127.0.0.1:58046)
0808 07:11:13.795464 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:13.795473 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:13.795515 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:13.795783 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:13.795784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:13.795785 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:13.795826 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:13.795828 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.797537 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.797538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:13.798595 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:13.798598 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.799628 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.799628 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:13.799707 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:13.799711 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:11:13.799772 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 07:11:13.799823 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"mutex_wait_us":8,"thread_start_us":114,"threads_started":1}
I20260808 07:11:13.800001 28963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:13.795249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56354 (local address 127.9.94.1:43737)
0808 07:11:13.795463 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:13.795469 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:13.795480 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:11:13.795587 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:13.795589 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:13.795605 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:13.795696 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:13.795912 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.797381 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.798742 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.799456 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.799531 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:13.799582 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:13.799811 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 07:11:13.799867 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":87,"threads_started":1}
I20260808 07:11:13.800450 28965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:13.795333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58046 (local address 127.9.94.2:34517)
0808 07:11:13.795547 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:13.795552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:13.795562 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:11:13.795598 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:13.795599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:13.795613 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:13.795707 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:13.795911 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.797371 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.798696 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:13.799461 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:13.799531 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:13.799582 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:13.800301 (+ 719us) server_negotiation.cc:299] Negotiation successful
0808 07:11:13.800354 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":98,"threads_started":1}
I20260808 07:11:13.800604 28879 tablet_service.cc:1467] Processing CreateTablet for tablet 694bed799253479c80b6c4ef50f76dda (DEFAULT_TABLE table=test-table [id=851e15d8e98044b190cd21693492a3ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:13.800854 28585 tablet_service.cc:1467] Processing CreateTablet for tablet 694bed799253479c80b6c4ef50f76dda (DEFAULT_TABLE table=test-table [id=851e15d8e98044b190cd21693492a3ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:13.801133 28735 tablet_service.cc:1467] Processing CreateTablet for tablet 694bed799253479c80b6c4ef50f76dda (DEFAULT_TABLE table=test-table [id=851e15d8e98044b190cd21693492a3ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:13.801299 28585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 694bed799253479c80b6c4ef50f76dda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:13.801450 28735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 694bed799253479c80b6c4ef50f76dda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:13.801455 28879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 694bed799253479c80b6c4ef50f76dda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:13.804047 28966 tablet_bootstrap.cc:492] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f: Bootstrap starting.
I20260808 07:11:13.804787 28967 tablet_bootstrap.cc:492] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26: Bootstrap starting.
I20260808 07:11:13.804944 28966 tablet_bootstrap.cc:654] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:13.805437 28967 tablet_bootstrap.cc:654] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:13.805549 28966 log.cc:824] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:13.805920 28968 tablet_bootstrap.cc:492] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d: Bootstrap starting.
I20260808 07:11:13.806058 28967 log.cc:824] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:13.806567 28966 tablet_bootstrap.cc:492] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f: No bootstrap required, opened a new log
I20260808 07:11:13.806651 28968 tablet_bootstrap.cc:654] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:13.806704 28966 ts_tablet_manager.cc:1397] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:11:13.806828 28967 tablet_bootstrap.cc:492] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26: No bootstrap required, opened a new log
I20260808 07:11:13.806921 28967 ts_tablet_manager.cc:1397] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:11:13.807268 28968 log.cc:824] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:13.808262 28968 tablet_bootstrap.cc:492] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d: No bootstrap required, opened a new log
I20260808 07:11:13.808348 28968 ts_tablet_manager.cc:1397] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:11:13.808692 28967 raft_consensus.cc:348] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af61174127594db582cc1a2c3e5a9e26" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43737 } } peers { permanent_uuid: "85b73da659ff4de7947d33ed48075a7f" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45043 } } peers { permanent_uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34517 } }
I20260808 07:11:13.808933 28967 raft_consensus.cc:374] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:13.808982 28967 raft_consensus.cc:729] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af61174127594db582cc1a2c3e5a9e26, State: Initialized, Role: FOLLOWER
I20260808 07:11:13.809103 28967 consensus_queue.cc:260] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af61174127594db582cc1a2c3e5a9e26" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43737 } } peers { permanent_uuid: "85b73da659ff4de7947d33ed48075a7f" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45043 } } peers { permanent_uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34517 } }
I20260808 07:11:13.809419 28967 ts_tablet_manager.cc:1428] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 07:11:13.809562 28655 heartbeater.cc:503] Master 127.9.94.62:34107 was elected leader, sending a full tablet report...
I20260808 07:11:13.809772 28966 raft_consensus.cc:348] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af61174127594db582cc1a2c3e5a9e26" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43737 } } peers { permanent_uuid: "85b73da659ff4de7947d33ed48075a7f" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45043 } } peers { permanent_uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34517 } }
I20260808 07:11:13.810043 28966 raft_consensus.cc:374] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:13.810086 28966 raft_consensus.cc:729] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b73da659ff4de7947d33ed48075a7f, State: Initialized, Role: FOLLOWER
I20260808 07:11:13.810237 28966 consensus_queue.cc:260] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af61174127594db582cc1a2c3e5a9e26" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43737 } } peers { permanent_uuid: "85b73da659ff4de7947d33ed48075a7f" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45043 } } peers { permanent_uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34517 } }
I20260808 07:11:13.810676 28966 ts_tablet_manager.cc:1428] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 07:11:13.810811 28949 heartbeater.cc:503] Master 127.9.94.62:34107 was elected leader, sending a full tablet report...
I20260808 07:11:13.810676 28968 raft_consensus.cc:348] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af61174127594db582cc1a2c3e5a9e26" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43737 } } peers { permanent_uuid: "85b73da659ff4de7947d33ed48075a7f" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45043 } } peers { permanent_uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34517 } }
I20260808 07:11:13.810866 28968 raft_consensus.cc:374] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:13.810917 28968 raft_consensus.cc:729] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6ea1c0a01fa45c583ae1fdb58c0ea3d, State: Initialized, Role: FOLLOWER
I20260808 07:11:13.811088 28968 consensus_queue.cc:260] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af61174127594db582cc1a2c3e5a9e26" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43737 } } peers { permanent_uuid: "85b73da659ff4de7947d33ed48075a7f" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45043 } } peers { permanent_uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34517 } }
I20260808 07:11:13.811408 28968 ts_tablet_manager.cc:1428] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:11:13.811452 28806 heartbeater.cc:503] Master 127.9.94.62:34107 was elected leader, sending a full tablet report...
W20260808 07:11:13.825596 28807 tablet.cc:2369] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:11:13.896948 28656 tablet.cc:2369] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:11:14.005050 28950 tablet.cc:2369] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:11:14.012358 28972 raft_consensus.cc:482] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:11:14.012547 28972 raft_consensus.cc:504] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af61174127594db582cc1a2c3e5a9e26" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43737 } } peers { permanent_uuid: "85b73da659ff4de7947d33ed48075a7f" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45043 } } peers { permanent_uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34517 } }
I20260808 07:11:14.013043 28972 leader_election.cc:288] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b73da659ff4de7947d33ed48075a7f (127.9.94.3:45043), f6ea1c0a01fa45c583ae1fdb58c0ea3d (127.9.94.2:34517)
I20260808 07:11:14.017977 28964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.013433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:33737 (local address 127.9.94.3:45043)
0808 07:11:14.013486 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:14.013489 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:14.013631 (+ 142us) server_negotiation.cc:407] Connection header received
0808 07:11:14.013683 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:14.013684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:14.013696 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:14.013754 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:14.014031 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.014758 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.016772 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.017444 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.017528 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.017540 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:14.017845 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 07:11:14.017901 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:11:14.017966 28977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.013301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:34517 (local address 127.9.94.1:46241)
0808 07:11:14.013469 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:14.013481 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:14.013559 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:14.013760 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:14.013760 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:14.013765 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:14.013897 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.013899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.014963 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.014966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.016468 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.016474 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.017599 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.017601 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.017706 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.017715 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 07:11:14.017785 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 07:11:14.017849 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":242,"thread_start_us":88,"threads_started":1}
I20260808 07:11:14.018054 28965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.013439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:46241 (local address 127.9.94.2:34517)
0808 07:11:14.013486 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:14.013489 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:14.013547 (+ 58us) server_negotiation.cc:407] Connection header received
0808 07:11:14.013646 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:14.013647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:14.013661 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:14.013747 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:14.014000 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.014761 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.016719 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.017437 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.017528 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.017540 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:14.017909 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 07:11:14.017959 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:11:14.018224 28975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.013301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:45043 (local address 127.9.94.1:33737)
0808 07:11:14.013551 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:14.013561 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:14.013626 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:14.013760 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:14.013760 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:14.013763 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:14.013902 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.013903 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.014963 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.014966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.016476 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.016478 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.017601 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.017601 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.017706 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.017713 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 07:11:14.017784 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 07:11:14.017849 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":101,"thread_start_us":70,"threads_started":1}
I20260808 07:11:14.018436 28756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694bed799253479c80b6c4ef50f76dda" candidate_uuid: "af61174127594db582cc1a2c3e5a9e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d" is_pre_election: true
I20260808 07:11:14.018639 28756 raft_consensus.cc:2454] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af61174127594db582cc1a2c3e5a9e26 in term 0.
I20260808 07:11:14.018700 28899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694bed799253479c80b6c4ef50f76dda" candidate_uuid: "af61174127594db582cc1a2c3e5a9e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b73da659ff4de7947d33ed48075a7f" is_pre_election: true
I20260808 07:11:14.018867 28899 raft_consensus.cc:2454] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af61174127594db582cc1a2c3e5a9e26 in term 0.
I20260808 07:11:14.018944 28536 leader_election.cc:302] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af61174127594db582cc1a2c3e5a9e26, f6ea1c0a01fa45c583ae1fdb58c0ea3d; no voters:
I20260808 07:11:14.019116 28972 raft_consensus.cc:2781] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:11:14.019179 28972 raft_consensus.cc:482] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:11:14.019203 28972 raft_consensus.cc:3037] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:14.020048 28972 raft_consensus.cc:504] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af61174127594db582cc1a2c3e5a9e26" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43737 } } peers { permanent_uuid: "85b73da659ff4de7947d33ed48075a7f" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45043 } } peers { permanent_uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34517 } }
I20260808 07:11:14.020208 28972 leader_election.cc:288] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [CANDIDATE]: Term 1 election: Requested vote from peers 85b73da659ff4de7947d33ed48075a7f (127.9.94.3:45043), f6ea1c0a01fa45c583ae1fdb58c0ea3d (127.9.94.2:34517)
I20260808 07:11:14.020402 28756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694bed799253479c80b6c4ef50f76dda" candidate_uuid: "af61174127594db582cc1a2c3e5a9e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d"
I20260808 07:11:14.020395 28899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694bed799253479c80b6c4ef50f76dda" candidate_uuid: "af61174127594db582cc1a2c3e5a9e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b73da659ff4de7947d33ed48075a7f"
I20260808 07:11:14.020495 28756 raft_consensus.cc:3037] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:14.020495 28899 raft_consensus.cc:3037] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:14.021552 28899 raft_consensus.cc:2454] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af61174127594db582cc1a2c3e5a9e26 in term 1.
I20260808 07:11:14.021552 28756 raft_consensus.cc:2454] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af61174127594db582cc1a2c3e5a9e26 in term 1.
I20260808 07:11:14.021783 28536 leader_election.cc:302] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af61174127594db582cc1a2c3e5a9e26, f6ea1c0a01fa45c583ae1fdb58c0ea3d; no voters:
I20260808 07:11:14.021898 28972 raft_consensus.cc:2781] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:14.022079 28972 raft_consensus.cc:686] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [term 1 LEADER]: Becoming Leader. State: Replica: af61174127594db582cc1a2c3e5a9e26, State: Running, Role: LEADER
I20260808 07:11:14.022183 28972 consensus_queue.cc:237] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af61174127594db582cc1a2c3e5a9e26" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43737 } } peers { permanent_uuid: "85b73da659ff4de7947d33ed48075a7f" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45043 } } peers { permanent_uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34517 } }
I20260808 07:11:14.023231 28451 catalog_manager.cc:5495] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 reported cstate change: term changed from 0 to 1, leader changed from <none> to af61174127594db582cc1a2c3e5a9e26 (127.9.94.1). New cstate: current_term: 1 leader_uuid: "af61174127594db582cc1a2c3e5a9e26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af61174127594db582cc1a2c3e5a9e26" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 43737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85b73da659ff4de7947d33ed48075a7f" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34517 } health_report { overall_health: UNKNOWN } } }
I20260808 07:11:14.036161 28963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.033290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56364 (local address 127.9.94.1:43737)
0808 07:11:14.033369 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:14.033371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:14.033380 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:11:14.033419 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:14.033420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:14.033442 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:14.033518 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:14.033751 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.034271 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.035176 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.035403 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.035469 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.035657 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:14.035754 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:14.035861 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:14.036077 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 07:11:14.036087 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 07:11:14.038398 28899 raft_consensus.cc:1261] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f [term 1 FOLLOWER]: Refusing update from remote peer af61174127594db582cc1a2c3e5a9e26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:14.038403 28756 raft_consensus.cc:1261] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d [term 1 FOLLOWER]: Refusing update from remote peer af61174127594db582cc1a2c3e5a9e26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:14.038781 28972 consensus_queue.cc:1035] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b73da659ff4de7947d33ed48075a7f" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 45043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:14.038945 28978 consensus_queue.cc:1035] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6ea1c0a01fa45c583ae1fdb58c0ea3d" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:14.041306 28981 mvcc.cc:205] Tried to move back new op lower bound from 7316164911258177536 to 7316164911195459584. Current Snapshot: MvccSnapshot[applied={T|T < 7316164911258177536}]
I20260808 07:11:14.042114 28982 mvcc.cc:205] Tried to move back new op lower bound from 7316164911258177536 to 7316164911195459584. Current Snapshot: MvccSnapshot[applied={T|T < 7316164911258177536}]
I20260808 07:11:14.044910 28451 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:11:14.045017 28451 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:11:14.046156 28451 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 43f65293a5b74ed1b858988c831f244a: Sending DeleteTablet for 3 replicas of tablet 694bed799253479c80b6c4ef50f76dda
I20260808 07:11:14.046571 28585 tablet_service.cc:1514] Processing DeleteTablet for tablet 694bed799253479c80b6c4ef50f76dda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:14 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:56354
I20260808 07:11:14.046634 28879 tablet_service.cc:1514] Processing DeleteTablet for tablet 694bed799253479c80b6c4ef50f76dda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:14 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:38340
I20260808 07:11:14.046721 28735 tablet_service.cc:1514] Processing DeleteTablet for tablet 694bed799253479c80b6c4ef50f76dda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:14 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:58046
I20260808 07:11:14.046909 28992 tablet_replica.cc:330] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f: stopping tablet replica
I20260808 07:11:14.046968 28991 tablet_replica.cc:330] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26: stopping tablet replica
I20260808 07:11:14.047035 28992 raft_consensus.cc:2229] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:11:14.047053 28991 raft_consensus.cc:2229] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:11:14.047163 28992 raft_consensus.cc:2258] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:14.047178 28991 raft_consensus.cc:2258] T 694bed799253479c80b6c4ef50f76dda P af61174127594db582cc1a2c3e5a9e26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:14.047578 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 28516
I20260808 07:11:14.047798 28992 ts_tablet_manager.cc:1905] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:11:14.049582 28993 tablet_replica.cc:330] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d: stopping tablet replica
I20260808 07:11:14.049782 28992 ts_tablet_manager.cc:1918] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:11:14.049998 28992 log.cc:1196] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/694bed799253479c80b6c4ef50f76dda
I20260808 07:11:14.050375 28992 ts_tablet_manager.cc:1939] T 694bed799253479c80b6c4ef50f76dda P 85b73da659ff4de7947d33ed48075a7f: Deleting consensus metadata
I20260808 07:11:14.050849 28993 raft_consensus.cc:2229] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:11:14.050879 28436 catalog_manager.cc:4841] TS 85b73da659ff4de7947d33ed48075a7f (127.9.94.3:45043): tablet 694bed799253479c80b6c4ef50f76dda (table test-table [id=851e15d8e98044b190cd21693492a3ef]) successfully deleted
I20260808 07:11:14.050998 28993 raft_consensus.cc:2258] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:14.051482 28993 ts_tablet_manager.cc:1905] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:11:14.054075 28993 ts_tablet_manager.cc:1918] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:11:14.054176 28993 log.cc:1196] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/694bed799253479c80b6c4ef50f76dda
I20260808 07:11:14.054450 28993 ts_tablet_manager.cc:1939] T 694bed799253479c80b6c4ef50f76dda P f6ea1c0a01fa45c583ae1fdb58c0ea3d: Deleting consensus metadata
I20260808 07:11:14.055099 28438 catalog_manager.cc:4841] TS f6ea1c0a01fa45c583ae1fdb58c0ea3d (127.9.94.2:34517): tablet 694bed799253479c80b6c4ef50f76dda (table test-table [id=851e15d8e98044b190cd21693492a3ef]) successfully deleted
W20260808 07:11:14.056939 28439 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:43737 (error 108)
I20260808 07:11:14.056973 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 28660
I20260808 07:11:14.061219 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.061041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:43737 (local address 127.0.0.1:56370)
0808 07:11:14.061110 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:14.061163 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 07:11:14.061619 28439 catalog_manager.cc:4584] TS af61174127594db582cc1a2c3e5a9e26 (127.9.94.1:43737): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 694bed799253479c80b6c4ef50f76dda: Network error: Client connection negotiation failed: client connection to 127.9.94.1:43737: connect: Connection refused (error 111)
I20260808 07:11:14.063931 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 28811
I20260808 07:11:14.072271 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 28419
2026-08-08T07:11:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2393 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T07:11:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:14Z Disabled control of system clock
I20260808 07:11:14.109459 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:37209
--webserver_interface=127.9.94.62
--webserver_port=0
--builtin_ntp_servers=127.9.94.20:38067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:37209
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:11:14.202064 28998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:14.202333 28998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:14.202359 28998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:14.203598 28998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:14.203644 28998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:14.203658 28998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:14.203672 28998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:14.203684 28998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:14.205279 28998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:37209
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:37209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:14.205536 28998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:14.205811 28998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:14.211582 29006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:14.211582 29004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:14.211642 28998 server_base.cc:1034] running on GCE node
W20260808 07:11:14.211606 29003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:14.212191 28998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:14.212574 28998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:14.213847 28998 hybrid_clock.cc:648] HybridClock initialized: now 1786173074213780 us; error 84 us; skew 500 ppm
I20260808 07:11:14.215485 28998 webserver.cc:460] Webserver started at http://127.9.94.62:46811/ using document root <none> and password file <none>
I20260808 07:11:14.215862 28998 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:14.215941 28998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:14.216101 28998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:14.217458 28998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "1b553439d1b2464d8da56044a18f784a"
format_stamp: "Formatted at 2026-08-08 07:11:14 on dist-test-slave-77v9"
server_key: "8e3d767007c58d75c6598eef5d2c650a"
server_key_iv: "d217f557855b47c8cd20eee895edc7ef"
server_key_version: "encryptionkey@0"
I20260808 07:11:14.217902 28998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "1b553439d1b2464d8da56044a18f784a"
format_stamp: "Formatted at 2026-08-08 07:11:14 on dist-test-slave-77v9"
server_key: "8e3d767007c58d75c6598eef5d2c650a"
server_key_iv: "d217f557855b47c8cd20eee895edc7ef"
server_key_version: "encryptionkey@0"
I20260808 07:11:14.219444 28998 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:11:14.220264 29013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:14.220683 28998 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:14.220849 28998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "1b553439d1b2464d8da56044a18f784a"
format_stamp: "Formatted at 2026-08-08 07:11:14 on dist-test-slave-77v9"
server_key: "8e3d767007c58d75c6598eef5d2c650a"
server_key_iv: "d217f557855b47c8cd20eee895edc7ef"
server_key_version: "encryptionkey@0"
I20260808 07:11:14.220956 28998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:14.242209 28998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:14.242614 28998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:14.242786 28998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:14.247670 28998 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:37209
I20260808 07:11:14.247714 29068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:37209 every 8 connection(s)
I20260808 07:11:14.248097 28998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:14.249264 29070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:14.251667 29070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a: Bootstrap starting.
I20260808 07:11:14.252328 29070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:14.252705 29070 log.cc:824] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:14.253522 29070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a: No bootstrap required, opened a new log
I20260808 07:11:14.255198 29070 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b553439d1b2464d8da56044a18f784a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37209 } }
I20260808 07:11:14.255396 29070 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:14.255421 29070 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b553439d1b2464d8da56044a18f784a, State: Initialized, Role: FOLLOWER
I20260808 07:11:14.255594 29070 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b553439d1b2464d8da56044a18f784a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37209 } }
I20260808 07:11:14.255694 29070 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:14.255734 29070 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:14.255836 29070 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:14.256050 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 28998
I20260808 07:11:14.256206 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:14.256474 9592 external_mini_cluster.cc:1428] Setting key a4175c5a2defa75fec73a4c577064f20
I20260808 07:11:14.256623 29070 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b553439d1b2464d8da56044a18f784a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37209 } }
I20260808 07:11:14.256759 29070 leader_election.cc:302] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b553439d1b2464d8da56044a18f784a; no voters:
I20260808 07:11:14.256989 29070 leader_election.cc:288] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:14.257099 29073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:14.257246 29073 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [term 1 LEADER]: Becoming Leader. State: Replica: 1b553439d1b2464d8da56044a18f784a, State: Running, Role: LEADER
I20260808 07:11:14.257302 29070 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:14.257419 29073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b553439d1b2464d8da56044a18f784a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37209 } }
I20260808 07:11:14.257881 29073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b553439d1b2464d8da56044a18f784a. Latest consensus state: current_term: 1 leader_uuid: "1b553439d1b2464d8da56044a18f784a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b553439d1b2464d8da56044a18f784a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37209 } } }
I20260808 07:11:14.258009 29074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b553439d1b2464d8da56044a18f784a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b553439d1b2464d8da56044a18f784a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 37209 } } }
I20260808 07:11:14.258118 29074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:14.258054 29073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:14.258598 29085 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:14.259099 29085 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:14.260756 29085 catalog_manager.cc:1347] Generated new cluster ID: 655e8ea777394b06b404e252e1ecef43
I20260808 07:11:14.260840 29085 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:14.263258 29076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.257101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36220 (local address 127.9.94.62:37209)
0808 07:11:14.257359 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:14.257369 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:14.257707 (+ 338us) server_negotiation.cc:407] Connection header received
0808 07:11:14.257838 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:14.257846 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:14.257920 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:14.258059 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:14.258443 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.260009 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.261097 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.261604 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.261755 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.262551 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:14.262554 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:14.262555 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:14.262752 (+ 197us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:14.262785 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:14.262797 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:14.262874 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:14.262951 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 07:11:14.263036 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":112,"threads_started":1}
I20260808 07:11:14.287186 29085 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:14.288020 29085 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:14.294865 29085 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a: Generated new TSK 0
I20260808 07:11:14.295125 29085 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:14.300071 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37209
--builtin_ntp_servers=127.9.94.20:38067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:11:14.401590 29095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:14.401826 29095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:14.401851 29095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:14.403069 29095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:14.403116 29095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:14.403154 29095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:11:14.404578 29095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:14.404891 29095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:14.405238 29095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:14.411098 29100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:14.411126 29101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:14.411129 29103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:14.411612 29095 server_base.cc:1034] running on GCE node
I20260808 07:11:14.411842 29095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:14.412127 29095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:14.413341 29095 hybrid_clock.cc:648] HybridClock initialized: now 1786173074413323 us; error 31 us; skew 500 ppm
I20260808 07:11:14.414897 29095 webserver.cc:460] Webserver started at http://127.9.94.1:34389/ using document root <none> and password file <none>
I20260808 07:11:14.415198 29095 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:14.415277 29095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:14.415444 29095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:14.417028 29095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "ee2eec70a9764d32ac9b7e1efc73b447"
format_stamp: "Formatted at 2026-08-08 07:11:14 on dist-test-slave-77v9"
server_key: "9ffedc60091347965532970a82e58ea9"
server_key_iv: "798d497638194df6e3742129c504bd06"
server_key_version: "encryptionkey@0"
I20260808 07:11:14.417528 29095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "ee2eec70a9764d32ac9b7e1efc73b447"
format_stamp: "Formatted at 2026-08-08 07:11:14 on dist-test-slave-77v9"
server_key: "9ffedc60091347965532970a82e58ea9"
server_key_iv: "798d497638194df6e3742129c504bd06"
server_key_version: "encryptionkey@0"
I20260808 07:11:14.419308 29095 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260808 07:11:14.420274 29109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:14.420549 29095 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:14.420677 29095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "ee2eec70a9764d32ac9b7e1efc73b447"
format_stamp: "Formatted at 2026-08-08 07:11:14 on dist-test-slave-77v9"
server_key: "9ffedc60091347965532970a82e58ea9"
server_key_iv: "798d497638194df6e3742129c504bd06"
server_key_version: "encryptionkey@0"
I20260808 07:11:14.420764 29095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:14.429693 29095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:14.430044 29095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:14.430203 29095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:14.430454 29095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:14.430807 29095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:14.430867 29095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:14.430915 29095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:14.430953 29095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:14.437469 29095 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:44163
I20260808 07:11:14.437546 29231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:44163 every 8 connection(s)
I20260808 07:11:14.437911 29095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:11:14.444788 29076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.438753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:60473 (local address 127.9.94.62:37209)
0808 07:11:14.438854 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:14.438857 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:14.439115 (+ 258us) server_negotiation.cc:407] Connection header received
0808 07:11:14.439719 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:14.439721 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:14.439738 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:14.439804 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:14.440609 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.441289 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.442416 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.442642 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.442731 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.444154 (+ 1423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:14.444156 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:14.444157 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:14.444167 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:14.444187 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:14.444193 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:14.444291 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:14.444641 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 07:11:14.444682 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 07:11:14.445128 29234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.438626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:37209 (local address 127.9.94.1:60473)
0808 07:11:14.438964 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:14.439012 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:14.439596 (+ 584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:14.439889 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:14.439892 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:14.439901 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:14.440503 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.440509 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.441398 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.441399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.442288 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.442291 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.442740 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.442741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.442899 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.443696 (+ 797us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:11:14.443697 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:14.443748 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:11:14.443789 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:14.444319 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:14.444330 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:14.444338 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 07:11:14.444645 (+ 307us) client_negotiation.cc:240] Negotiation successful
0808 07:11:14.444788 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":103,"threads_started":1}
I20260808 07:11:14.445843 29232 heartbeater.cc:347] Connected to a master server at 127.9.94.62:37209
I20260808 07:11:14.445967 29232 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:14.446188 29232 heartbeater.cc:511] Master 127.9.94.62:37209 requested a full tablet report, sending...
I20260808 07:11:14.446873 29032 ts_manager.cc:194] Registered new tserver with Master: ee2eec70a9764d32ac9b7e1efc73b447 (127.9.94.1:44163)
I20260808 07:11:14.447497 29032 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.94.1:60473
I20260808 07:11:14.447917 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 29095
I20260808 07:11:14.448043 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:11:14.448316 9592 external_mini_cluster.cc:1428] Setting key b5d4f64a23396dbc7f18bd20a8cfa483
I20260808 07:11:14.449589 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37209
--builtin_ntp_servers=127.9.94.20:38067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:11:14.547327 29235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:14.547597 29235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:14.547637 29235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:14.549492 29235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:14.549634 29235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:14.549693 29235 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:11:14.552320 29235 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:14.552743 29235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:14.553227 29235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:14.559033 29243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:14.559032 29240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:14.559032 29241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:14.559562 29235 server_base.cc:1034] running on GCE node
I20260808 07:11:14.559800 29235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:14.560129 29235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:14.561297 29235 hybrid_clock.cc:648] HybridClock initialized: now 1786173074561281 us; error 29 us; skew 500 ppm
I20260808 07:11:14.563261 29235 webserver.cc:460] Webserver started at http://127.9.94.2:46639/ using document root <none> and password file <none>
I20260808 07:11:14.563629 29235 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:14.563719 29235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:14.563912 29235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:14.565295 29235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "bd312f91ff0f416a8566c3e1bde492f0"
format_stamp: "Formatted at 2026-08-08 07:11:14 on dist-test-slave-77v9"
server_key: "83065179ce15fddbbad90aef541e492f"
server_key_iv: "716cdd6811294bc0653c654ca6fa8d38"
server_key_version: "encryptionkey@0"
I20260808 07:11:14.565703 29235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "bd312f91ff0f416a8566c3e1bde492f0"
format_stamp: "Formatted at 2026-08-08 07:11:14 on dist-test-slave-77v9"
server_key: "83065179ce15fddbbad90aef541e492f"
server_key_iv: "716cdd6811294bc0653c654ca6fa8d38"
server_key_version: "encryptionkey@0"
I20260808 07:11:14.567294 29235 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:11:14.568250 29249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:14.568727 29235 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:14.568969 29235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "bd312f91ff0f416a8566c3e1bde492f0"
format_stamp: "Formatted at 2026-08-08 07:11:14 on dist-test-slave-77v9"
server_key: "83065179ce15fddbbad90aef541e492f"
server_key_iv: "716cdd6811294bc0653c654ca6fa8d38"
server_key_version: "encryptionkey@0"
I20260808 07:11:14.569069 29235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:14.610771 29235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:14.611176 29235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:14.611362 29235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:14.611644 29235 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:14.612040 29235 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:14.612104 29235 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:14.612178 29235 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:14.612233 29235 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:14.619122 29235 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:41481
I20260808 07:11:14.619212 29370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:41481 every 8 connection(s)
I20260808 07:11:14.619545 29235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:11:14.625681 29076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.620486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:59425 (local address 127.9.94.62:37209)
0808 07:11:14.620581 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:14.620583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:14.620782 (+ 199us) server_negotiation.cc:407] Connection header received
0808 07:11:14.621414 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:14.621416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:14.621431 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:14.621496 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:14.622204 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.622743 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.623815 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.624028 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.624109 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.625352 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:14.625354 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:14.625355 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:14.625367 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:14.625381 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:14.625386 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:14.625452 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:14.625558 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 07:11:14.625592 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 07:11:14.625970 29373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.620404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:37209 (local address 127.9.94.2:59425)
0808 07:11:14.620658 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:14.620692 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:14.621259 (+ 567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:14.621570 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:14.621579 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:14.621586 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:14.622109 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.622113 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.622850 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.622852 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.623722 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.623725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.624117 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.624118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.624258 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.625057 (+ 799us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:11:14.625058 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:14.625089 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:11:14.625113 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:14.625455 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:14.625461 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:14.625464 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:11:14.625558 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 07:11:14.625671 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":98,"threads_started":1}
I20260808 07:11:14.626644 29371 heartbeater.cc:347] Connected to a master server at 127.9.94.62:37209
I20260808 07:11:14.626756 29371 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:14.626951 29371 heartbeater.cc:511] Master 127.9.94.62:37209 requested a full tablet report, sending...
I20260808 07:11:14.627456 29032 ts_manager.cc:194] Registered new tserver with Master: bd312f91ff0f416a8566c3e1bde492f0 (127.9.94.2:41481)
I20260808 07:11:14.627899 29032 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.94.2:59425
I20260808 07:11:14.628129 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 29235
I20260808 07:11:14.628254 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:11:14.628504 9592 external_mini_cluster.cc:1428] Setting key a92c7b53e43fd7f190f320c57e346305
I20260808 07:11:14.629527 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37209
--builtin_ntp_servers=127.9.94.20:38067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:11:14.723565 29374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:14.723819 29374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:14.723846 29374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:14.725169 29374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:14.725226 29374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:14.725255 29374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:11:14.727113 29374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:38067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:37209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:14.727695 29374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:14.728159 29374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:11:14.734300 29374 server_base.cc:1034] running on GCE node
W20260808 07:11:14.734300 29381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:14.734294 29383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:14.734519 29380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:14.734803 29374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:14.735095 29374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:14.736266 29374 hybrid_clock.cc:648] HybridClock initialized: now 1786173074736244 us; error 77 us; skew 500 ppm
I20260808 07:11:14.737872 29374 webserver.cc:460] Webserver started at http://127.9.94.3:45837/ using document root <none> and password file <none>
I20260808 07:11:14.738200 29374 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:14.738298 29374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:14.738505 29374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:14.739725 29374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "b7ccd1af9024421794df450435db0133"
format_stamp: "Formatted at 2026-08-08 07:11:14 on dist-test-slave-77v9"
server_key: "0ba07acb90fc6bc20e3ae3436705dfbd"
server_key_iv: "68c7e65a6dfa3378cb1939c4fa24f5bb"
server_key_version: "encryptionkey@0"
I20260808 07:11:14.740128 29374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "b7ccd1af9024421794df450435db0133"
format_stamp: "Formatted at 2026-08-08 07:11:14 on dist-test-slave-77v9"
server_key: "0ba07acb90fc6bc20e3ae3436705dfbd"
server_key_iv: "68c7e65a6dfa3378cb1939c4fa24f5bb"
server_key_version: "encryptionkey@0"
I20260808 07:11:14.741814 29374 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260808 07:11:14.742969 29389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:14.743185 29374 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:14.743328 29374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "b7ccd1af9024421794df450435db0133"
format_stamp: "Formatted at 2026-08-08 07:11:14 on dist-test-slave-77v9"
server_key: "0ba07acb90fc6bc20e3ae3436705dfbd"
server_key_iv: "68c7e65a6dfa3378cb1939c4fa24f5bb"
server_key_version: "encryptionkey@0"
I20260808 07:11:14.743419 29374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:14.759931 29374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:14.760313 29374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:14.760469 29374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:14.760744 29374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:14.761238 29374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:14.761279 29374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:14.761305 29374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:14.761323 29374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:14.768666 29374 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:38739
I20260808 07:11:14.768769 29509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:38739 every 8 connection(s)
I20260808 07:11:14.769248 29374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:11:14.775521 29076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.770110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:35203 (local address 127.9.94.62:37209)
0808 07:11:14.770192 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:14.770199 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:14.770480 (+ 281us) server_negotiation.cc:407] Connection header received
0808 07:11:14.770965 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:14.770966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:14.770978 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:14.771056 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:14.771817 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.772383 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.773610 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.773818 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.773899 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.775119 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:14.775121 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:14.775121 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:14.775126 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:14.775142 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:14.775147 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:14.775213 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:14.775417 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 07:11:14.775451 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 07:11:14.775753 29514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.770100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:37209 (local address 127.9.94.3:35203)
0808 07:11:14.770312 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:14.770355 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:14.770848 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:14.771111 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:14.771115 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:14.771123 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:14.771659 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.771663 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.772520 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.772521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.773485 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.773488 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.773964 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.773965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.774096 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.774921 (+ 825us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:11:14.774921 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:14.774954 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:11:14.774982 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:14.775262 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:14.775268 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:14.775271 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:11:14.775353 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 07:11:14.775475 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":102,"threads_started":1}
I20260808 07:11:14.776533 29512 heartbeater.cc:347] Connected to a master server at 127.9.94.62:37209
I20260808 07:11:14.776669 29512 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:14.776787 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 29374
I20260808 07:11:14.776970 29512 heartbeater.cc:511] Master 127.9.94.62:37209 requested a full tablet report, sending...
I20260808 07:11:14.777047 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:11:14.777328 9592 external_mini_cluster.cc:1428] Setting key 218a50e1bad641e82410c9694d2ff597
I20260808 07:11:14.777436 29032 ts_manager.cc:194] Registered new tserver with Master: b7ccd1af9024421794df450435db0133 (127.9.94.3:38739)
I20260808 07:11:14.777977 29032 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.94.3:35203
I20260808 07:11:14.778502 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:11:14.783778 29076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.780263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36226 (local address 127.9.94.62:37209)
0808 07:11:14.780347 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:14.780349 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:14.780408 (+ 59us) server_negotiation.cc:407] Connection header received
0808 07:11:14.780463 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:14.780464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:14.780474 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:14.780534 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:14.780698 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.781334 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.782234 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.782443 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.782554 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.783443 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:14.783444 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:14.783445 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:14.783450 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:14.783471 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:14.783476 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:14.783575 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:14.783664 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 07:11:14.783677 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 07:11:14.786270 29031 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36226:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:11:14.787978 29031 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:11:14.795397 29521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.790685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:44163 (local address 127.0.0.1:38082)
0808 07:11:14.791006 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:14.791017 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:14.791086 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:14.791304 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:14.791308 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:14.791310 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:14.791421 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.791424 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.792981 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.792982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.794100 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.794103 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.795056 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.795058 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.795145 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.795161 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 07:11:14.795211 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 07:11:14.795282 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":67,"thread_start_us":66,"threads_started":1}
I20260808 07:11:14.795555 29527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.791036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36994 (local address 127.9.94.3:38739)
0808 07:11:14.791257 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:14.791261 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:14.791466 (+ 205us) server_negotiation.cc:407] Connection header received
0808 07:11:14.791514 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:14.791516 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:14.791532 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:14.791618 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:14.791773 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.792905 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.794409 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.794976 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.795081 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.795186 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:14.795263 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 07:11:14.795305 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":92,"threads_started":1}
I20260808 07:11:14.795403 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.790860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:38739 (local address 127.0.0.1:36994)
0808 07:11:14.791304 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:14.791314 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:14.791372 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:14.791632 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:14.791633 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:14.791646 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:14.791685 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.791687 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.792994 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.792995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.794312 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.794314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.795084 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.795085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.795153 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.795177 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 07:11:14.795244 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 07:11:14.795294 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"mutex_wait_us":43,"thread_start_us":41,"threads_started":1}
I20260808 07:11:14.795773 29523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.790736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36336 (local address 127.9.94.2:41481)
0808 07:11:14.791242 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:14.791247 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:14.791260 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:11:14.791306 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:14.791308 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:14.791327 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:14.791414 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:14.791521 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.792453 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.794319 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.795007 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.795265 (+ 258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.795371 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:14.795397 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 07:11:14.795444 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":100,"threads_started":1}
I20260808 07:11:14.795670 29522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.790619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:41481 (local address 127.0.0.1:36336)
0808 07:11:14.790852 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:14.790904 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:14.791058 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:14.791410 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:14.791410 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:14.791412 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:14.791450 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.791451 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.792559 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.792560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.794223 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.794226 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.795096 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.795097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:14.795151 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.795161 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 07:11:14.795211 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 07:11:14.795617 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":383,"thread_start_us":92,"threads_started":1}
I20260808 07:11:14.796137 29526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.790814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38082 (local address 127.9.94.1:44163)
0808 07:11:14.791009 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:14.791015 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:14.791075 (+ 60us) server_negotiation.cc:407] Connection header received
0808 07:11:14.791160 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:14.791162 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:14.791179 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:14.791297 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:14.791532 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.792868 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.794189 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:14.794944 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:14.795791 (+ 847us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:14.795970 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:14.795998 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 07:11:14.796042 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":105,"threads_started":1}
I20260808 07:11:14.796880 29300 tablet_service.cc:1467] Processing CreateTablet for tablet 6021efa020164fe5a2263b7d072bef9e (DEFAULT_TABLE table=test-table [id=ca5d855ed4484b32a33d47866e0bbefa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:14.796898 29159 tablet_service.cc:1467] Processing CreateTablet for tablet 6021efa020164fe5a2263b7d072bef9e (DEFAULT_TABLE table=test-table [id=ca5d855ed4484b32a33d47866e0bbefa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:14.797022 29439 tablet_service.cc:1467] Processing CreateTablet for tablet 6021efa020164fe5a2263b7d072bef9e (DEFAULT_TABLE table=test-table [id=ca5d855ed4484b32a33d47866e0bbefa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:14.797224 29300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6021efa020164fe5a2263b7d072bef9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:14.797298 29159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6021efa020164fe5a2263b7d072bef9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:14.797329 29439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6021efa020164fe5a2263b7d072bef9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:14.799940 29528 tablet_bootstrap.cc:492] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0: Bootstrap starting.
I20260808 07:11:14.800575 29528 tablet_bootstrap.cc:654] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:14.800882 29528 log.cc:824] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:14.800983 29529 tablet_bootstrap.cc:492] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447: Bootstrap starting.
I20260808 07:11:14.801501 29530 tablet_bootstrap.cc:492] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133: Bootstrap starting.
I20260808 07:11:14.801781 29529 tablet_bootstrap.cc:654] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:14.802028 29528 tablet_bootstrap.cc:492] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0: No bootstrap required, opened a new log
I20260808 07:11:14.802134 29528 ts_tablet_manager.cc:1397] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:11:14.802377 29529 log.cc:824] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:14.802397 29530 tablet_bootstrap.cc:654] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:14.802865 29530 log.cc:824] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:14.803328 29529 tablet_bootstrap.cc:492] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447: No bootstrap required, opened a new log
I20260808 07:11:14.803426 29529 ts_tablet_manager.cc:1397] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:11:14.803993 29530 tablet_bootstrap.cc:492] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133: No bootstrap required, opened a new log
I20260808 07:11:14.804088 29530 ts_tablet_manager.cc:1397] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:11:14.804837 29528 raft_consensus.cc:348] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd312f91ff0f416a8566c3e1bde492f0" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41481 } } peers { permanent_uuid: "b7ccd1af9024421794df450435db0133" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 38739 } } peers { permanent_uuid: "ee2eec70a9764d32ac9b7e1efc73b447" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44163 } }
I20260808 07:11:14.805049 29528 raft_consensus.cc:374] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:14.805104 29528 raft_consensus.cc:729] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd312f91ff0f416a8566c3e1bde492f0, State: Initialized, Role: FOLLOWER
I20260808 07:11:14.805267 29528 consensus_queue.cc:260] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd312f91ff0f416a8566c3e1bde492f0" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41481 } } peers { permanent_uuid: "b7ccd1af9024421794df450435db0133" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 38739 } } peers { permanent_uuid: "ee2eec70a9764d32ac9b7e1efc73b447" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44163 } }
I20260808 07:11:14.805564 29528 ts_tablet_manager.cc:1428] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 07:11:14.805685 29371 heartbeater.cc:503] Master 127.9.94.62:37209 was elected leader, sending a full tablet report...
I20260808 07:11:14.806551 29529 raft_consensus.cc:348] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd312f91ff0f416a8566c3e1bde492f0" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41481 } } peers { permanent_uuid: "b7ccd1af9024421794df450435db0133" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 38739 } } peers { permanent_uuid: "ee2eec70a9764d32ac9b7e1efc73b447" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44163 } }
I20260808 07:11:14.806736 29529 raft_consensus.cc:374] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:14.806778 29529 raft_consensus.cc:729] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee2eec70a9764d32ac9b7e1efc73b447, State: Initialized, Role: FOLLOWER
I20260808 07:11:14.806897 29529 consensus_queue.cc:260] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd312f91ff0f416a8566c3e1bde492f0" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41481 } } peers { permanent_uuid: "b7ccd1af9024421794df450435db0133" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 38739 } } peers { permanent_uuid: "ee2eec70a9764d32ac9b7e1efc73b447" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44163 } }
I20260808 07:11:14.807070 29530 raft_consensus.cc:348] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd312f91ff0f416a8566c3e1bde492f0" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41481 } } peers { permanent_uuid: "b7ccd1af9024421794df450435db0133" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 38739 } } peers { permanent_uuid: "ee2eec70a9764d32ac9b7e1efc73b447" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44163 } }
I20260808 07:11:14.807173 29529 ts_tablet_manager.cc:1428] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260808 07:11:14.807227 29530 raft_consensus.cc:374] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:14.807265 29530 raft_consensus.cc:729] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ccd1af9024421794df450435db0133, State: Initialized, Role: FOLLOWER
I20260808 07:11:14.807382 29530 consensus_queue.cc:260] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd312f91ff0f416a8566c3e1bde492f0" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41481 } } peers { permanent_uuid: "b7ccd1af9024421794df450435db0133" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 38739 } } peers { permanent_uuid: "ee2eec70a9764d32ac9b7e1efc73b447" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44163 } }
I20260808 07:11:14.807703 29530 ts_tablet_manager.cc:1428] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260808 07:11:14.807771 29232 heartbeater.cc:503] Master 127.9.94.62:37209 was elected leader, sending a full tablet report...
I20260808 07:11:14.808291 29512 heartbeater.cc:503] Master 127.9.94.62:37209 was elected leader, sending a full tablet report...
W20260808 07:11:14.870221 29372 tablet.cc:2369] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:11:14.938773 29233 tablet.cc:2369] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:11:14.998216 29534 raft_consensus.cc:482] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:11:14.998430 29534 raft_consensus.cc:504] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd312f91ff0f416a8566c3e1bde492f0" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41481 } } peers { permanent_uuid: "b7ccd1af9024421794df450435db0133" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 38739 } } peers { permanent_uuid: "ee2eec70a9764d32ac9b7e1efc73b447" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44163 } }
I20260808 07:11:14.998986 29534 leader_election.cc:288] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ccd1af9024421794df450435db0133 (127.9.94.3:38739), ee2eec70a9764d32ac9b7e1efc73b447 (127.9.94.1:44163)
I20260808 07:11:15.004215 29526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.999331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:38139 (local address 127.9.94.1:44163)
0808 07:11:14.999493 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:14.999495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:14.999506 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:11:14.999535 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:14.999536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:14.999547 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:14.999629 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:15.000075 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:15.001076 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:15.003082 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:15.003688 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:15.003781 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:15.003794 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:15.004077 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 07:11:15.004138 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260808 07:11:15.004215 29527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.999331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:42955 (local address 127.9.94.3:38739)
0808 07:11:14.999444 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:14.999446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:14.999670 (+ 224us) server_negotiation.cc:407] Connection header received
0808 07:11:15.000013 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:15.000016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:15.000035 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:15.000163 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:15.000455 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:15.001303 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:15.003076 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:15.003700 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:15.003781 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:15.003794 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:15.004077 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 07:11:15.004133 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 07:11:15.004212 29373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.999231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:44163 (local address 127.9.94.2:38139)
0808 07:11:14.999295 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:14.999306 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:14.999353 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:14.999662 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:14.999663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:14.999670 (+ 7us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:14.999908 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:14.999916 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:15.001243 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:15.001245 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:15.002845 (+ 1600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:15.002847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:15.003858 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:15.003859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:15.003944 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:15.003951 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 07:11:15.004027 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 07:11:15.004097 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":18}
I20260808 07:11:15.004218 29537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:14.999231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:38739 (local address 127.9.94.2:42955)
0808 07:11:14.999502 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:14.999509 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:14.999668 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:15.000244 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:15.000245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:15.000247 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:15.000337 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:15.000339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:15.001506 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:15.001507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:15.002844 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:15.002847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:15.003827 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:15.003829 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:15.003944 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:15.003952 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 07:11:15.004027 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 07:11:15.004097 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":30,"thread_start_us":124,"threads_started":1}
I20260808 07:11:15.004931 29180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6021efa020164fe5a2263b7d072bef9e" candidate_uuid: "bd312f91ff0f416a8566c3e1bde492f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee2eec70a9764d32ac9b7e1efc73b447" is_pre_election: true
I20260808 07:11:15.004992 29460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6021efa020164fe5a2263b7d072bef9e" candidate_uuid: "bd312f91ff0f416a8566c3e1bde492f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ccd1af9024421794df450435db0133" is_pre_election: true
I20260808 07:11:15.005229 29460 raft_consensus.cc:2454] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd312f91ff0f416a8566c3e1bde492f0 in term 0.
I20260808 07:11:15.005229 29180 raft_consensus.cc:2454] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd312f91ff0f416a8566c3e1bde492f0 in term 0.
I20260808 07:11:15.005591 29251 leader_election.cc:302] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ccd1af9024421794df450435db0133, bd312f91ff0f416a8566c3e1bde492f0; no voters:
I20260808 07:11:15.005785 29534 raft_consensus.cc:2781] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:11:15.005872 29534 raft_consensus.cc:482] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:11:15.005904 29534 raft_consensus.cc:3037] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:15.006705 29534 raft_consensus.cc:504] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd312f91ff0f416a8566c3e1bde492f0" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41481 } } peers { permanent_uuid: "b7ccd1af9024421794df450435db0133" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 38739 } } peers { permanent_uuid: "ee2eec70a9764d32ac9b7e1efc73b447" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44163 } }
I20260808 07:11:15.006893 29534 leader_election.cc:288] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [CANDIDATE]: Term 1 election: Requested vote from peers b7ccd1af9024421794df450435db0133 (127.9.94.3:38739), ee2eec70a9764d32ac9b7e1efc73b447 (127.9.94.1:44163)
I20260808 07:11:15.007117 29180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6021efa020164fe5a2263b7d072bef9e" candidate_uuid: "bd312f91ff0f416a8566c3e1bde492f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee2eec70a9764d32ac9b7e1efc73b447"
I20260808 07:11:15.007149 29460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6021efa020164fe5a2263b7d072bef9e" candidate_uuid: "bd312f91ff0f416a8566c3e1bde492f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ccd1af9024421794df450435db0133"
I20260808 07:11:15.007265 29180 raft_consensus.cc:3037] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:15.007340 29460 raft_consensus.cc:3037] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:15.008165 29180 raft_consensus.cc:2454] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd312f91ff0f416a8566c3e1bde492f0 in term 1.
I20260808 07:11:15.008354 29460 raft_consensus.cc:2454] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd312f91ff0f416a8566c3e1bde492f0 in term 1.
I20260808 07:11:15.008374 29252 leader_election.cc:302] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd312f91ff0f416a8566c3e1bde492f0, ee2eec70a9764d32ac9b7e1efc73b447; no voters:
I20260808 07:11:15.008463 29534 raft_consensus.cc:2781] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:15.008636 29534 raft_consensus.cc:686] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [term 1 LEADER]: Becoming Leader. State: Replica: bd312f91ff0f416a8566c3e1bde492f0, State: Running, Role: LEADER
I20260808 07:11:15.008746 29534 consensus_queue.cc:237] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd312f91ff0f416a8566c3e1bde492f0" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41481 } } peers { permanent_uuid: "b7ccd1af9024421794df450435db0133" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 38739 } } peers { permanent_uuid: "ee2eec70a9764d32ac9b7e1efc73b447" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44163 } }
I20260808 07:11:15.009768 29032 catalog_manager.cc:5495] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd312f91ff0f416a8566c3e1bde492f0 (127.9.94.2). New cstate: current_term: 1 leader_uuid: "bd312f91ff0f416a8566c3e1bde492f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd312f91ff0f416a8566c3e1bde492f0" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 41481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ccd1af9024421794df450435db0133" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 38739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee2eec70a9764d32ac9b7e1efc73b447" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44163 } health_report { overall_health: UNKNOWN } } }
W20260808 07:11:15.020025 29513 tablet.cc:2369] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:11:15.028725 29523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:15.026214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36338 (local address 127.9.94.2:41481)
0808 07:11:15.026287 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:15.026289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:15.026299 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:11:15.026345 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:15.026345 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:15.026371 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:15.026467 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:15.026616 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:15.027091 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:15.027854 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:15.028070 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:15.028151 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:15.028300 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:15.028409 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:15.028551 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:15.028604 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 07:11:15.028617 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 07:11:15.030902 29460 raft_consensus.cc:1261] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133 [term 1 FOLLOWER]: Refusing update from remote peer bd312f91ff0f416a8566c3e1bde492f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:15.030920 29180 raft_consensus.cc:1261] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447 [term 1 FOLLOWER]: Refusing update from remote peer bd312f91ff0f416a8566c3e1bde492f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:15.031337 29538 consensus_queue.cc:1035] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ccd1af9024421794df450435db0133" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 38739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:15.031497 29534 consensus_queue.cc:1035] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee2eec70a9764d32ac9b7e1efc73b447" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:15.034543 29544 mvcc.cc:205] Tried to move back new op lower bound from 7316164915323289600 to 7316164915236638720. Current Snapshot: MvccSnapshot[applied={T|T < 7316164915323289600}]
I20260808 07:11:15.037426 29031 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36226:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:11:15.037729 29031 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36226:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:11:15.038692 29031 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1b553439d1b2464d8da56044a18f784a: Sending DeleteTablet for 3 replicas of tablet 6021efa020164fe5a2263b7d072bef9e
I20260808 07:11:15.039147 29439 tablet_service.cc:1514] Processing DeleteTablet for tablet 6021efa020164fe5a2263b7d072bef9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:15 UTC) from {username='slave'} at 127.0.0.1:36994
I20260808 07:11:15.039196 29300 tablet_service.cc:1514] Processing DeleteTablet for tablet 6021efa020164fe5a2263b7d072bef9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:15 UTC) from {username='slave'} at 127.0.0.1:36336
I20260808 07:11:15.039256 29159 tablet_service.cc:1514] Processing DeleteTablet for tablet 6021efa020164fe5a2263b7d072bef9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:15 UTC) from {username='slave'} at 127.0.0.1:38082
I20260808 07:11:15.039515 29557 tablet_replica.cc:330] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447: stopping tablet replica
I20260808 07:11:15.039654 29557 raft_consensus.cc:2229] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:11:15.039687 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 29095
I20260808 07:11:15.039798 29557 raft_consensus.cc:2258] T 6021efa020164fe5a2263b7d072bef9e P ee2eec70a9764d32ac9b7e1efc73b447 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:15.039809 29554 tablet_replica.cc:330] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133: stopping tablet replica
I20260808 07:11:15.040234 29554 raft_consensus.cc:2229] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:11:15.040370 29554 raft_consensus.cc:2258] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:15.041080 29554 ts_tablet_manager.cc:1905] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:11:15.040562 29556 tablet_replica.cc:330] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0: stopping tablet replica
I20260808 07:11:15.043452 29554 ts_tablet_manager.cc:1918] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:11:15.043618 29556 raft_consensus.cc:2229] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:11:15.043756 29554 log.cc:1196] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/6021efa020164fe5a2263b7d072bef9e
I20260808 07:11:15.044145 29554 ts_tablet_manager.cc:1939] T 6021efa020164fe5a2263b7d072bef9e P b7ccd1af9024421794df450435db0133: Deleting consensus metadata
I20260808 07:11:15.044373 29556 raft_consensus.cc:2258] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:15.045252 29556 ts_tablet_manager.cc:1905] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:11:15.045778 29015 catalog_manager.cc:4841] TS b7ccd1af9024421794df450435db0133 (127.9.94.3:38739): tablet 6021efa020164fe5a2263b7d072bef9e (table test-table [id=ca5d855ed4484b32a33d47866e0bbefa]) successfully deleted
I20260808 07:11:15.047413 29556 ts_tablet_manager.cc:1918] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:11:15.047520 29556 log.cc:1196] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/6021efa020164fe5a2263b7d072bef9e
I20260808 07:11:15.047863 29556 ts_tablet_manager.cc:1939] T 6021efa020164fe5a2263b7d072bef9e P bd312f91ff0f416a8566c3e1bde492f0: Deleting consensus metadata
I20260808 07:11:15.048352 29015 catalog_manager.cc:4841] TS bd312f91ff0f416a8566c3e1bde492f0 (127.9.94.2:41481): tablet 6021efa020164fe5a2263b7d072bef9e (table test-table [id=ca5d855ed4484b32a33d47866e0bbefa]) successfully deleted
W20260808 07:11:15.051517 29017 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:44163 (error 108)
I20260808 07:11:15.052047 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 29235
I20260808 07:11:15.052127 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:15.051936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:44163 (local address 127.0.0.1:38092)
0808 07:11:15.052022 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:15.052086 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:44163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 07:11:15.054245 29017 catalog_manager.cc:4584] TS ee2eec70a9764d32ac9b7e1efc73b447 (127.9.94.1:44163): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6021efa020164fe5a2263b7d072bef9e: Network error: Client connection negotiation failed: client connection to 127.9.94.1:44163: connect: Connection refused (error 111)
I20260808 07:11:15.059568 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 29374
I20260808 07:11:15.067340 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 28998
2026-08-08T07:11:15Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (991 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:15 dist-test-slave-77v9 krb5kdc[29561](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:15 dist-test-slave-77v9 krb5kdc[29561](info): set up 2 sockets
Aug 08 07:11:15 dist-test-slave-77v9 krb5kdc[29561](info): commencing operation
krb5kdc: starting...
W20260808 07:11:16.209034 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:16 dist-test-slave-77v9 krb5kdc[29561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:11:16.357630 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:40363
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:40363
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:16.456069 29575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:16.456351 29575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:16.456383 29575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:16.458211 29575 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:16.458290 29575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:16.458307 29575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:16.458323 29575 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:16.458338 29575 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:16.460150 29575 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:40363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:40363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:16.460407 29575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:16.460623 29575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:16.467176 29584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:16.467219 29586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:16.467198 29581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:16.467790 29575 server_base.cc:1034] running on GCE node
I20260808 07:11:16.468091 29575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:16.468465 29575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:16.469792 29575 hybrid_clock.cc:648] HybridClock initialized: now 1786173076469718 us; error 71 us; skew 500 ppm
Aug 08 07:11:16 dist-test-slave-77v9 krb5kdc[29561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173076, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:16.474018 29575 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:11:16.475339 29575 webserver.cc:460] Webserver started at http://127.9.94.62:38309/ using document root <none> and password file <none>
I20260808 07:11:16.475713 29575 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:16.475785 29575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:16.475939 29575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:16.477573 29575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "5b139227f95143d6ac9c3054d8395a4c"
format_stamp: "Formatted at 2026-08-08 07:11:16 on dist-test-slave-77v9"
server_key: "d0384735f08855a0fd6c0d15a8a8a625"
server_key_iv: "37851b4e9cde3a317d095302665d190c"
server_key_version: "encryptionkey@0"
I20260808 07:11:16.478042 29575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "5b139227f95143d6ac9c3054d8395a4c"
format_stamp: "Formatted at 2026-08-08 07:11:16 on dist-test-slave-77v9"
server_key: "d0384735f08855a0fd6c0d15a8a8a625"
server_key_iv: "37851b4e9cde3a317d095302665d190c"
server_key_version: "encryptionkey@0"
I20260808 07:11:16.480084 29575 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 07:11:16.481678 29593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:16.482093 29575 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:16.482244 29575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "5b139227f95143d6ac9c3054d8395a4c"
format_stamp: "Formatted at 2026-08-08 07:11:16 on dist-test-slave-77v9"
server_key: "d0384735f08855a0fd6c0d15a8a8a625"
server_key_iv: "37851b4e9cde3a317d095302665d190c"
server_key_version: "encryptionkey@0"
I20260808 07:11:16.482589 29575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:16.496784 29575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:16.499888 29575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:16.500133 29575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:16.505827 29575 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:40363
I20260808 07:11:16.506278 29575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:16.506266 29654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:40363 every 8 connection(s)
I20260808 07:11:16.507783 29655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:16.510833 29655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c: Bootstrap starting.
I20260808 07:11:16.511564 29655 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:16.511888 29655 log.cc:824] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:16.512790 29655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c: No bootstrap required, opened a new log
I20260808 07:11:16.514599 29655 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b139227f95143d6ac9c3054d8395a4c" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40363 } }
I20260808 07:11:16.514753 29655 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:16.514776 29655 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b139227f95143d6ac9c3054d8395a4c, State: Initialized, Role: FOLLOWER
I20260808 07:11:16.514957 29655 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b139227f95143d6ac9c3054d8395a4c" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40363 } }
I20260808 07:11:16.515033 29655 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:16.515055 29655 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:16.515084 29655 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:16.515197 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 29575
I20260808 07:11:16.515286 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:16.515475 9592 external_mini_cluster.cc:1428] Setting key fa126d1fdaa27f8ad746273f82828c0f
I20260808 07:11:16.515622 29655 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b139227f95143d6ac9c3054d8395a4c" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40363 } }
I20260808 07:11:16.515733 29655 leader_election.cc:302] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b139227f95143d6ac9c3054d8395a4c; no voters:
I20260808 07:11:16.515981 29659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:16.516136 29659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [term 1 LEADER]: Becoming Leader. State: Replica: 5b139227f95143d6ac9c3054d8395a4c, State: Running, Role: LEADER
I20260808 07:11:16.516186 29655 leader_election.cc:288] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:16.516234 29659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b139227f95143d6ac9c3054d8395a4c" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40363 } }
I20260808 07:11:16.516466 29655 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:16.516577 29659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b139227f95143d6ac9c3054d8395a4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b139227f95143d6ac9c3054d8395a4c" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40363 } } }
I20260808 07:11:16.516638 29659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:16.516736 29663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b139227f95143d6ac9c3054d8395a4c. Latest consensus state: current_term: 1 leader_uuid: "5b139227f95143d6ac9c3054d8395a4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b139227f95143d6ac9c3054d8395a4c" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40363 } } }
I20260808 07:11:16.516832 29663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:16.517249 29667 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:16.517853 29667 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:16.519799 29667 catalog_manager.cc:1347] Generated new cluster ID: bbe07dd675dc47288893042420afc8b5
I20260808 07:11:16.519856 29667 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:11:16 dist-test-slave-77v9 krb5kdc[29561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:16.526427 29667 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:16.527395 29667 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:16.529646 29662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:16.516012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44532 (local address 127.9.94.62:40363)
0808 07:11:16.516296 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:16.516307 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:16.516646 (+ 339us) server_negotiation.cc:407] Connection header received
0808 07:11:16.516783 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:16.516791 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:16.516898 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:16.517039 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:16.518156 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:16.519407 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:16.520503 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:16.521139 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:16.521245 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:16.525072 (+ 3827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:16.525078 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:16.525079 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:16.525097 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:16.527617 (+ 2520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:16.528092 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:16.528096 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:16.528096 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:16.528220 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:16.528493 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:16.528494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:16.528494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:16.528772 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:16.528982 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:16.529133 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 07:11:16.529399 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":101,"threads_started":1}
I20260808 07:11:16.543351 29667 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c: Generated new TSK 0
I20260808 07:11:16.543576 29667 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.94.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
Entry for principal kudu/127.9.94.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab.
I20260808 07:11:16.581782 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:40363
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:16.683610 29685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:16.683894 29685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:16.683944 29685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:16.685273 29685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:16.685346 29685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:16.685397 29685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:11:16.687110 29685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.1.keytab
--principal=kudu/127.9.94.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:40363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:16.687418 29685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:16.687675 29685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:16.693315 29693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:16.693276 29690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:16.693276 29691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:16.693464 29685 server_base.cc:1034] running on GCE node
I20260808 07:11:16.693739 29685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:16.694031 29685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:16.695281 29685 hybrid_clock.cc:648] HybridClock initialized: now 1786173076695265 us; error 31 us; skew 500 ppm
Aug 08 07:11:16 dist-test-slave-77v9 krb5kdc[29561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173076, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:16.699076 29685 init.cc:377] Logged in from keytab as kudu/127.9.94.1@KRBTEST.COM (short username kudu)
I20260808 07:11:16.699959 29685 webserver.cc:460] Webserver started at http://127.9.94.1:45679/ using document root <none> and password file <none>
I20260808 07:11:16.700263 29685 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:16.700336 29685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:16.700501 29685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:16.701727 29685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "152b63a14a8d41dcbdd36729ef9f9e34"
format_stamp: "Formatted at 2026-08-08 07:11:16 on dist-test-slave-77v9"
server_key: "07450335487c7828e01c4a7af1bfc75b"
server_key_iv: "54bfbec53b7c7ae43433409d9ad60b14"
server_key_version: "encryptionkey@0"
I20260808 07:11:16.702114 29685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "152b63a14a8d41dcbdd36729ef9f9e34"
format_stamp: "Formatted at 2026-08-08 07:11:16 on dist-test-slave-77v9"
server_key: "07450335487c7828e01c4a7af1bfc75b"
server_key_iv: "54bfbec53b7c7ae43433409d9ad60b14"
server_key_version: "encryptionkey@0"
I20260808 07:11:16.704030 29685 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260808 07:11:16.705191 29701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:16.705535 29685 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260808 07:11:16.705674 29685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "152b63a14a8d41dcbdd36729ef9f9e34"
format_stamp: "Formatted at 2026-08-08 07:11:16 on dist-test-slave-77v9"
server_key: "07450335487c7828e01c4a7af1bfc75b"
server_key_iv: "54bfbec53b7c7ae43433409d9ad60b14"
server_key_version: "encryptionkey@0"
I20260808 07:11:16.705765 29685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:16.722606 29685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:16.725564 29685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:16.725769 29685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:16.726045 29685 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:16.726406 29685 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:16.726464 29685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:16.726502 29685 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:16.726549 29685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:16.734290 29685 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:45279
I20260808 07:11:16.734340 29822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:45279 every 8 connection(s)
I20260808 07:11:16.734728 29685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:11:16.739763 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 29685
I20260808 07:11:16.739888 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:11:16.740199 9592 external_mini_cluster.cc:1428] Setting key 2d6f291f62565202ca366050db95ed71
Aug 08 07:11:16 dist-test-slave-77v9 krb5kdc[29561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173076, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.1@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:16.747502 29662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:16.735750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:39939 (local address 127.9.94.62:40363)
0808 07:11:16.735872 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:16.735875 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:16.736291 (+ 416us) server_negotiation.cc:407] Connection header received
0808 07:11:16.736860 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:16.736861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:16.736875 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:16.736958 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:16.738215 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:16.738849 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:16.740141 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:16.740487 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:16.740606 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:16.743679 (+ 3073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:16.743681 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:16.743681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:16.743690 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:16.745430 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:16.746049 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:16.746050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:16.746050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:16.746117 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:16.746478 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:16.746480 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:16.746480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:16.746618 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:16.746691 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:16.747231 (+ 540us) server_negotiation.cc:299] Negotiation successful
0808 07:11:16.747403 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 07:11:16.747611 29825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:16.735583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:40363 (local address 127.9.94.1:39939)
0808 07:11:16.735909 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:16.735978 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:16.736669 (+ 691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:16.737099 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:16.737104 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:16.737803 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:16.738051 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:16.738063 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:16.738972 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:16.738973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:16.740042 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:16.740045 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:16.740621 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:16.740622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:16.740778 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:16.741440 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:16.741451 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:16.743507 (+ 2056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:16.745531 (+ 2024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:16.745540 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:16.745544 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:16.745924 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:16.746201 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:16.746202 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:16.746202 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:16.746367 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:16.746705 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:16.746713 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:16.746925 (+ 212us) client_negotiation.cc:769] Sending connection context
0808 07:11:16.747067 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 07:11:16.747285 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":100,"threads_started":1}
I20260808 07:11:16.748615 29823 heartbeater.cc:347] Connected to a master server at 127.9.94.62:40363
I20260808 07:11:16.748729 29823 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:16.749001 29823 heartbeater.cc:511] Master 127.9.94.62:40363 requested a full tablet report, sending...
I20260808 07:11:16.749709 29614 ts_manager.cc:194] Registered new tserver with Master: 152b63a14a8d41dcbdd36729ef9f9e34 (127.9.94.1:45279)
WARNING: no policy specified for kudu/127.9.94.2@KRBTEST.COM; defaulting to no policy
I20260808 07:11:16.750676 29614 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.1@KRBTEST.COM'} at 127.9.94.1:39939
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
Entry for principal kudu/127.9.94.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab.
I20260808 07:11:16.774549 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:40363
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:16.869122 29828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:16.869364 29828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:16.869390 29828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:16.870621 29828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:16.870672 29828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:16.870700 29828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:11:16.872119 29828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.2.keytab
--principal=kudu/127.9.94.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:40363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:16.872320 29828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:16.872522 29828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:16.879173 29833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:16.879163 29834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:16.879163 29836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:16.879413 29828 server_base.cc:1034] running on GCE node
I20260808 07:11:16.879765 29828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:16.880091 29828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:16.881282 29828 hybrid_clock.cc:648] HybridClock initialized: now 1786173076881242 us; error 56 us; skew 500 ppm
Aug 08 07:11:16 dist-test-slave-77v9 krb5kdc[29561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173076, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:16.885512 29828 init.cc:377] Logged in from keytab as kudu/127.9.94.2@KRBTEST.COM (short username kudu)
I20260808 07:11:16.886181 29828 webserver.cc:460] Webserver started at http://127.9.94.2:43655/ using document root <none> and password file <none>
I20260808 07:11:16.886543 29828 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:16.886627 29828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:16.886834 29828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:16.888185 29828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "e098470252dc413aad342e697a451992"
format_stamp: "Formatted at 2026-08-08 07:11:16 on dist-test-slave-77v9"
server_key: "581f26ae22e95bd15228900b8bd3eabe"
server_key_iv: "0082d53f724b8fade4c3f3257d2c5d1b"
server_key_version: "encryptionkey@0"
I20260808 07:11:16.888604 29828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "e098470252dc413aad342e697a451992"
format_stamp: "Formatted at 2026-08-08 07:11:16 on dist-test-slave-77v9"
server_key: "581f26ae22e95bd15228900b8bd3eabe"
server_key_iv: "0082d53f724b8fade4c3f3257d2c5d1b"
server_key_version: "encryptionkey@0"
I20260808 07:11:16.890537 29828 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260808 07:11:16.891607 29843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:16.892027 29828 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:16.892174 29828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "e098470252dc413aad342e697a451992"
format_stamp: "Formatted at 2026-08-08 07:11:16 on dist-test-slave-77v9"
server_key: "581f26ae22e95bd15228900b8bd3eabe"
server_key_iv: "0082d53f724b8fade4c3f3257d2c5d1b"
server_key_version: "encryptionkey@0"
I20260808 07:11:16.892282 29828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:16.902748 29828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:16.905900 29828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:16.906164 29828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:16.906680 29828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:16.907157 29828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:16.907222 29828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:16.907271 29828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:16.907299 29828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:16.918994 29961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:39803 every 8 connection(s)
I20260808 07:11:16.919037 29828 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:39803
I20260808 07:11:16.919593 29828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:11:16.922783 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 29828
I20260808 07:11:16.922961 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:11:16.923164 9592 external_mini_cluster.cc:1428] Setting key 72350c8408c371fb7802ba21a1f9c094
Aug 08 07:11:16 dist-test-slave-77v9 krb5kdc[29561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173076, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.2@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.94.3@KRBTEST.COM; defaulting to no policy
I20260808 07:11:16.934337 29662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:16.920552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:57561 (local address 127.9.94.62:40363)
0808 07:11:16.920629 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:16.920631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:16.920952 (+ 321us) server_negotiation.cc:407] Connection header received
0808 07:11:16.921572 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:16.921574 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:16.921592 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:16.921716 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:16.923401 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:16.923924 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:16.926462 (+ 2538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:16.926796 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:16.926888 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:16.929787 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:16.929790 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:16.929790 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:16.929802 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:16.931915 (+ 2113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:16.932719 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:16.932720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:16.932721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:16.932796 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:16.933327 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:16.933328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:16.933329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:16.933526 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:16.933609 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:16.934117 (+ 508us) server_negotiation.cc:299] Negotiation successful
0808 07:11:16.934223 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 07:11:16.934470 29964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:16.920494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:40363 (local address 127.9.94.2:57561)
0808 07:11:16.920715 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:16.920766 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:16.921386 (+ 620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:16.921885 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:16.921891 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:16.922717 (+ 826us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:16.923079 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:16.923088 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:16.924930 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:16.924932 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:16.926286 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:16.926290 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:16.926930 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:16.926932 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:16.927067 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:16.927742 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:16.927752 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:16.929656 (+ 1904us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:16.932126 (+ 2470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:16.932143 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:16.932146 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:16.932551 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:16.933038 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:16.933039 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:16.933039 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:16.933213 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:16.933699 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:16.933707 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:16.933859 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 07:11:16.934050 (+ 191us) client_negotiation.cc:240] Negotiation successful
0808 07:11:16.934240 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":105,"threads_started":1}
I20260808 07:11:16.935345 29962 heartbeater.cc:347] Connected to a master server at 127.9.94.62:40363
I20260808 07:11:16.935529 29962 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:16.935860 29962 heartbeater.cc:511] Master 127.9.94.62:40363 requested a full tablet report, sending...
I20260808 07:11:16.936591 29614 ts_manager.cc:194] Registered new tserver with Master: e098470252dc413aad342e697a451992 (127.9.94.2:39803)
I20260808 07:11:16.937104 29614 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.2@KRBTEST.COM'} at 127.9.94.2:57561
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
Entry for principal kudu/127.9.94.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab.
I20260808 07:11:16.961130 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:40363
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:41189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:17.060617 29968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:17.060952 29968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:17.061000 29968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:17.062239 29968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:17.062350 29968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:17.062402 29968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:11:17.063992 29968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:41189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.3.keytab
--principal=kudu/127.9.94.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:40363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:17.064291 29968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:17.064544 29968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:17.070293 29973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:17.070307 29977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:17.070386 29974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:17.070609 29968 server_base.cc:1034] running on GCE node
I20260808 07:11:17.070837 29968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:17.071089 29968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:17.072325 29968 hybrid_clock.cc:648] HybridClock initialized: now 1786173077072298 us; error 41 us; skew 500 ppm
Aug 08 07:11:17 dist-test-slave-77v9 krb5kdc[29561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173077, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:17.075275 29968 init.cc:377] Logged in from keytab as kudu/127.9.94.3@KRBTEST.COM (short username kudu)
I20260808 07:11:17.075875 29968 webserver.cc:460] Webserver started at http://127.9.94.3:44909/ using document root <none> and password file <none>
I20260808 07:11:17.076165 29968 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:17.076246 29968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:17.076423 29968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:17.077732 29968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "e932fa70769b4b20913f3d99209b6a39"
format_stamp: "Formatted at 2026-08-08 07:11:17 on dist-test-slave-77v9"
server_key: "049b6c74c5f59181a97609d0f1718be5"
server_key_iv: "a401e121246d524db5af36d70c66dcfa"
server_key_version: "encryptionkey@0"
I20260808 07:11:17.078151 29968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "e932fa70769b4b20913f3d99209b6a39"
format_stamp: "Formatted at 2026-08-08 07:11:17 on dist-test-slave-77v9"
server_key: "049b6c74c5f59181a97609d0f1718be5"
server_key_iv: "a401e121246d524db5af36d70c66dcfa"
server_key_version: "encryptionkey@0"
I20260808 07:11:17.079738 29968 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:11:17.080874 29984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:17.081089 29968 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:11:17.081226 29968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "e932fa70769b4b20913f3d99209b6a39"
format_stamp: "Formatted at 2026-08-08 07:11:17 on dist-test-slave-77v9"
server_key: "049b6c74c5f59181a97609d0f1718be5"
server_key_iv: "a401e121246d524db5af36d70c66dcfa"
server_key_version: "encryptionkey@0"
I20260808 07:11:17.081329 29968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:17.127095 29968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:17.130897 29968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:17.131139 29968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:17.131678 29968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:17.132225 29968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:17.132311 29968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:17.132360 29968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:17.132414 29968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:17.140884 29968 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:32897
I20260808 07:11:17.140956 30103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:32897 every 8 connection(s)
I20260808 07:11:17.141319 29968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:11:17 dist-test-slave-77v9 krb5kdc[29561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173077, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.3@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:17.150249 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 29968
I20260808 07:11:17.150440 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:11:17.150729 9592 external_mini_cluster.cc:1428] Setting key 2eb1465eefdfbbab835c23fadb5ba1cf
I20260808 07:11:17.155153 29662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.142343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:51079 (local address 127.9.94.62:40363)
0808 07:11:17.142483 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.142486 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.142658 (+ 172us) server_negotiation.cc:407] Connection header received
0808 07:11:17.143234 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.143236 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.143253 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.143362 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:17.144490 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.145180 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.146277 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.146596 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.146714 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.150448 (+ 3734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:17.150451 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:17.150452 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:17.150464 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:17.152335 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:17.153228 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:17.153229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:17.153230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:17.153301 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:17.153811 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:17.153813 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:17.153814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:17.153998 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:17.154154 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.154823 (+ 669us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.154969 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 07:11:17.155460 30106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.142202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:40363 (local address 127.9.94.3:51079)
0808 07:11:17.142435 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:17.142487 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:17.143041 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:17.143473 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:17.143477 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:17.144116 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:17.144331 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.144336 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.145285 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.145287 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.146109 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.146112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.146747 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.146749 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.146937 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.147632 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:17.147646 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:17.150292 (+ 2646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:17.152515 (+ 2223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:17.152531 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:17.152534 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:17.153099 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:17.153461 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:17.153463 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:17.153463 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:17.153640 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:17.154215 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:17.154227 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:17.154423 (+ 196us) client_negotiation.cc:769] Sending connection context
0808 07:11:17.154662 (+ 239us) client_negotiation.cc:240] Negotiation successful
0808 07:11:17.155105 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":152,"threads_started":1}
I20260808 07:11:17.156499 30104 heartbeater.cc:347] Connected to a master server at 127.9.94.62:40363
I20260808 07:11:17.156651 30104 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:17.156998 30104 heartbeater.cc:511] Master 127.9.94.62:40363 requested a full tablet report, sending...
I20260808 07:11:17.157723 29614 ts_manager.cc:194] Registered new tserver with Master: e932fa70769b4b20913f3d99209b6a39 (127.9.94.3:32897)
I20260808 07:11:17.158244 29614 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.94.3@KRBTEST.COM'} at 127.9.94.3:51079
I20260808 07:11:17.163944 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:11:17.174911 29662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.166274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44534 (local address 127.9.94.62:40363)
0808 07:11:17.166365 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.166367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.166551 (+ 184us) server_negotiation.cc:407] Connection header received
0808 07:11:17.166582 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.166583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.166595 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.166670 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:17.167384 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.168034 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.169165 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.169381 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.169459 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.171901 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:17.171903 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:17.171903 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:17.171911 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:17.173628 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:17.174053 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:17.174054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:17.174054 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:17.174113 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:17.174361 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:17.174361 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:17.174362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:17.174535 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:17.174620 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.174750 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.174829 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 07:11:17.177433 29614 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44534:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:11:17.179201 29614 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:11:17.187109 30116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.181984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:39803 (local address 127.0.0.1:40436)
0808 07:11:17.182402 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:17.182412 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:17.182455 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:17.182885 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:17.182889 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:17.182891 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:17.182970 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.182976 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.184371 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.184372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.185909 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.185912 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.186827 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.186829 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.186894 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.186898 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:11:17.186956 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:11:17.187020 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"mutex_wait_us":18,"thread_start_us":75,"threads_started":1}
I20260808 07:11:17.187093 30120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.182233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40436 (local address 127.9.94.2:39803)
0808 07:11:17.182592 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.182597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.182606 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:11:17.182648 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.182650 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.182665 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.182767 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:17.183082 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.184216 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.186016 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.186743 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.186829 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.186907 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.186966 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.187010 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":86,"threads_started":1}
I20260808 07:11:17.187091 30119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.182160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44538 (local address 127.9.94.3:32897)
0808 07:11:17.182359 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.182364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.182532 (+ 168us) server_negotiation.cc:407] Connection header received
0808 07:11:17.182681 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.182684 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.182700 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.182793 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:17.183040 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.183803 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.185742 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.186580 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.186657 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.186716 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.186924 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.186979 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":130,"threads_started":1}
I20260808 07:11:17.187806 30121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.182406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52488 (local address 127.9.94.1:45279)
0808 07:11:17.182618 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.182639 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.182649 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:11:17.182685 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.182781 (+ 96us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.182800 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.182872 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:17.183088 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.184232 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.186540 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.187377 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.187449 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.187511 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.187688 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.187728 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":104,"threads_started":1}
I20260808 07:11:17.187803 30115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.181952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:45279 (local address 127.0.0.1:52488)
0808 07:11:17.182230 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:17.182274 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:17.182347 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:17.182950 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:17.182951 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:17.182953 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:17.183018 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.183021 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.184350 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.184351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.186409 (+ 2058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.186413 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.187547 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.187548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.187612 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.187617 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:11:17.187673 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 07:11:17.187720 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":109,"thread_start_us":68,"threads_started":1}
I20260808 07:11:17.187927 30118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.182053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:32897 (local address 127.0.0.1:44538)
0808 07:11:17.182477 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:17.182485 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:17.182532 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:17.182941 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:17.182941 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:17.182943 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:17.182985 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.182987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.183934 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.183935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.185425 (+ 1490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.185430 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.186674 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.186675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.186770 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.186791 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 07:11:17.187738 (+ 947us) client_negotiation.cc:240] Negotiation successful
0808 07:11:17.187800 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"mutex_wait_us":8,"thread_start_us":102,"threads_started":1}
I20260808 07:11:17.188402 29894 tablet_service.cc:1467] Processing CreateTablet for tablet 67b8fb8077d54c17bcd8cf4ffa59541e (DEFAULT_TABLE table=test-table [id=57aba19497f849eaaae66eb7885537cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:17.188872 29894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67b8fb8077d54c17bcd8cf4ffa59541e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:17.188966 29752 tablet_service.cc:1467] Processing CreateTablet for tablet 67b8fb8077d54c17bcd8cf4ffa59541e (DEFAULT_TABLE table=test-table [id=57aba19497f849eaaae66eb7885537cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:17.189386 29752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67b8fb8077d54c17bcd8cf4ffa59541e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:17.189646 30034 tablet_service.cc:1467] Processing CreateTablet for tablet 67b8fb8077d54c17bcd8cf4ffa59541e (DEFAULT_TABLE table=test-table [id=57aba19497f849eaaae66eb7885537cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:17.189996 30034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67b8fb8077d54c17bcd8cf4ffa59541e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:17.191998 30122 tablet_bootstrap.cc:492] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992: Bootstrap starting.
I20260808 07:11:17.192689 30122 tablet_bootstrap.cc:654] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:17.193274 30122 log.cc:824] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:17.193480 30123 tablet_bootstrap.cc:492] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34: Bootstrap starting.
I20260808 07:11:17.194077 30125 tablet_bootstrap.cc:492] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39: Bootstrap starting.
I20260808 07:11:17.194227 30123 tablet_bootstrap.cc:654] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:17.194417 30122 tablet_bootstrap.cc:492] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992: No bootstrap required, opened a new log
I20260808 07:11:17.194516 30122 ts_tablet_manager.cc:1397] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:11:17.194881 30125 tablet_bootstrap.cc:654] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:17.194907 30123 log.cc:824] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:17.195569 30125 log.cc:824] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:17.195891 30123 tablet_bootstrap.cc:492] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34: No bootstrap required, opened a new log
I20260808 07:11:17.195986 30123 ts_tablet_manager.cc:1397] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:11:17.196506 30125 tablet_bootstrap.cc:492] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39: No bootstrap required, opened a new log
I20260808 07:11:17.196585 30125 ts_tablet_manager.cc:1397] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:11:17.197036 30122 raft_consensus.cc:348] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e932fa70769b4b20913f3d99209b6a39" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 32897 } } peers { permanent_uuid: "e098470252dc413aad342e697a451992" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 39803 } } peers { permanent_uuid: "152b63a14a8d41dcbdd36729ef9f9e34" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 45279 } }
I20260808 07:11:17.197250 30122 raft_consensus.cc:374] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:17.197291 30122 raft_consensus.cc:729] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e098470252dc413aad342e697a451992, State: Initialized, Role: FOLLOWER
I20260808 07:11:17.197467 30122 consensus_queue.cc:260] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e932fa70769b4b20913f3d99209b6a39" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 32897 } } peers { permanent_uuid: "e098470252dc413aad342e697a451992" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 39803 } } peers { permanent_uuid: "152b63a14a8d41dcbdd36729ef9f9e34" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 45279 } }
I20260808 07:11:17.197842 30122 ts_tablet_manager.cc:1428] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 07:11:17.197878 29962 heartbeater.cc:503] Master 127.9.94.62:40363 was elected leader, sending a full tablet report...
I20260808 07:11:17.198763 30125 raft_consensus.cc:348] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e932fa70769b4b20913f3d99209b6a39" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 32897 } } peers { permanent_uuid: "e098470252dc413aad342e697a451992" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 39803 } } peers { permanent_uuid: "152b63a14a8d41dcbdd36729ef9f9e34" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 45279 } }
I20260808 07:11:17.198684 30123 raft_consensus.cc:348] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e932fa70769b4b20913f3d99209b6a39" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 32897 } } peers { permanent_uuid: "e098470252dc413aad342e697a451992" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 39803 } } peers { permanent_uuid: "152b63a14a8d41dcbdd36729ef9f9e34" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 45279 } }
I20260808 07:11:17.198972 30125 raft_consensus.cc:374] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:17.199011 30123 raft_consensus.cc:374] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:17.199023 30125 raft_consensus.cc:729] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e932fa70769b4b20913f3d99209b6a39, State: Initialized, Role: FOLLOWER
I20260808 07:11:17.199065 30123 raft_consensus.cc:729] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 152b63a14a8d41dcbdd36729ef9f9e34, State: Initialized, Role: FOLLOWER
I20260808 07:11:17.199160 30125 consensus_queue.cc:260] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e932fa70769b4b20913f3d99209b6a39" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 32897 } } peers { permanent_uuid: "e098470252dc413aad342e697a451992" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 39803 } } peers { permanent_uuid: "152b63a14a8d41dcbdd36729ef9f9e34" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 45279 } }
I20260808 07:11:17.199235 30123 consensus_queue.cc:260] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e932fa70769b4b20913f3d99209b6a39" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 32897 } } peers { permanent_uuid: "e098470252dc413aad342e697a451992" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 39803 } } peers { permanent_uuid: "152b63a14a8d41dcbdd36729ef9f9e34" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 45279 } }
I20260808 07:11:17.199512 30104 heartbeater.cc:503] Master 127.9.94.62:40363 was elected leader, sending a full tablet report...
I20260808 07:11:17.199513 30125 ts_tablet_manager.cc:1428] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:11:17.199579 29823 heartbeater.cc:503] Master 127.9.94.62:40363 was elected leader, sending a full tablet report...
I20260808 07:11:17.199577 30123 ts_tablet_manager.cc:1428] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 07:11:17.203025 30129 raft_consensus.cc:482] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:11:17.203127 30129 raft_consensus.cc:504] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e932fa70769b4b20913f3d99209b6a39" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 32897 } } peers { permanent_uuid: "e098470252dc413aad342e697a451992" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 39803 } } peers { permanent_uuid: "152b63a14a8d41dcbdd36729ef9f9e34" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 45279 } }
I20260808 07:11:17.203500 30129 leader_election.cc:288] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e932fa70769b4b20913f3d99209b6a39 (127.9.94.3:32897), 152b63a14a8d41dcbdd36729ef9f9e34 (127.9.94.1:45279)
I20260808 07:11:17.207556 30119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.203713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:46315 (local address 127.9.94.3:32897)
0808 07:11:17.203760 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.203762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.203771 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:11:17.203831 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.203832 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.203844 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.203896 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:17.204090 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.204716 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.206231 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.207089 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.207182 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.207195 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.207425 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.207461 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:11:17.207576 29964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.203657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:32897 (local address 127.9.94.2:46315)
0808 07:11:17.203712 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:17.203724 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:17.203767 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:17.203954 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:17.203955 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:17.203957 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:17.204033 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.204035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.204797 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.204798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.206118 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.206121 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.207201 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.207202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.207330 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.207336 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:11:17.207419 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 07:11:17.207481 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 07:11:17.207630 30121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.204044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:58749 (local address 127.9.94.1:45279)
0808 07:11:17.204091 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.204094 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.204104 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:11:17.204137 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.204138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.204146 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.204240 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:17.204432 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.205064 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.206478 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.207223 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.207290 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.207323 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.207522 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.207559 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:11:17.207893 30132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.203732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:45279 (local address 127.9.94.2:58749)
0808 07:11:17.203949 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:17.203959 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:17.204000 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:17.204236 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:17.204237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:17.204239 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:17.204339 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.204341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.205148 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.205149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.206354 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.206356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.207359 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.207360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.207445 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.207449 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:11:17.207509 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 07:11:17.207544 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":126,"threads_started":1}
I20260808 07:11:17.208076 30054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67b8fb8077d54c17bcd8cf4ffa59541e" candidate_uuid: "e098470252dc413aad342e697a451992" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e932fa70769b4b20913f3d99209b6a39" is_pre_election: true
I20260808 07:11:17.208267 30054 raft_consensus.cc:2454] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e098470252dc413aad342e697a451992 in term 0.
I20260808 07:11:17.208333 29774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67b8fb8077d54c17bcd8cf4ffa59541e" candidate_uuid: "e098470252dc413aad342e697a451992" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "152b63a14a8d41dcbdd36729ef9f9e34" is_pre_election: true
I20260808 07:11:17.208513 29774 raft_consensus.cc:2454] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e098470252dc413aad342e697a451992 in term 0.
I20260808 07:11:17.208534 29846 leader_election.cc:302] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e098470252dc413aad342e697a451992, e932fa70769b4b20913f3d99209b6a39; no voters:
I20260808 07:11:17.208706 30129 raft_consensus.cc:2781] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:11:17.208779 30129 raft_consensus.cc:482] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:11:17.208846 30129 raft_consensus.cc:3037] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:17.209616 30129 raft_consensus.cc:504] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e932fa70769b4b20913f3d99209b6a39" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 32897 } } peers { permanent_uuid: "e098470252dc413aad342e697a451992" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 39803 } } peers { permanent_uuid: "152b63a14a8d41dcbdd36729ef9f9e34" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 45279 } }
I20260808 07:11:17.209784 30129 leader_election.cc:288] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [CANDIDATE]: Term 1 election: Requested vote from peers e932fa70769b4b20913f3d99209b6a39 (127.9.94.3:32897), 152b63a14a8d41dcbdd36729ef9f9e34 (127.9.94.1:45279)
I20260808 07:11:17.210026 29774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67b8fb8077d54c17bcd8cf4ffa59541e" candidate_uuid: "e098470252dc413aad342e697a451992" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "152b63a14a8d41dcbdd36729ef9f9e34"
I20260808 07:11:17.210027 30054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67b8fb8077d54c17bcd8cf4ffa59541e" candidate_uuid: "e098470252dc413aad342e697a451992" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e932fa70769b4b20913f3d99209b6a39"
I20260808 07:11:17.210117 29774 raft_consensus.cc:3037] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:17.210129 30054 raft_consensus.cc:3037] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:17.211151 29774 raft_consensus.cc:2454] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e098470252dc413aad342e697a451992 in term 1.
I20260808 07:11:17.211151 30054 raft_consensus.cc:2454] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e098470252dc413aad342e697a451992 in term 1.
I20260808 07:11:17.211360 29844 leader_election.cc:302] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 152b63a14a8d41dcbdd36729ef9f9e34, e098470252dc413aad342e697a451992; no voters:
I20260808 07:11:17.211512 30129 raft_consensus.cc:2781] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:17.211686 30129 raft_consensus.cc:686] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [term 1 LEADER]: Becoming Leader. State: Replica: e098470252dc413aad342e697a451992, State: Running, Role: LEADER
I20260808 07:11:17.211766 30129 consensus_queue.cc:237] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e932fa70769b4b20913f3d99209b6a39" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 32897 } } peers { permanent_uuid: "e098470252dc413aad342e697a451992" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 39803 } } peers { permanent_uuid: "152b63a14a8d41dcbdd36729ef9f9e34" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 45279 } }
I20260808 07:11:17.212641 29613 catalog_manager.cc:5495] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 reported cstate change: term changed from 0 to 1, leader changed from <none> to e098470252dc413aad342e697a451992 (127.9.94.2). New cstate: current_term: 1 leader_uuid: "e098470252dc413aad342e697a451992" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e932fa70769b4b20913f3d99209b6a39" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 32897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e098470252dc413aad342e697a451992" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 39803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "152b63a14a8d41dcbdd36729ef9f9e34" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 45279 } health_report { overall_health: UNKNOWN } } }
I20260808 07:11:17.223157 30120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.219479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40438 (local address 127.9.94.2:39803)
0808 07:11:17.219563 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.219566 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.219576 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:11:17.219625 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.219625 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.219644 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.219715 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:17.220144 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.220922 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.221834 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.222061 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.222133 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.222625 (+ 492us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:17.222743 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:17.222853 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.222983 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.223012 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 07:11:17.226208 29774 raft_consensus.cc:1261] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34 [term 1 FOLLOWER]: Refusing update from remote peer e098470252dc413aad342e697a451992: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:17.226370 30054 raft_consensus.cc:1261] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39 [term 1 FOLLOWER]: Refusing update from remote peer e098470252dc413aad342e697a451992: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:17.226795 30129 consensus_queue.cc:1035] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [LEADER]: Connected to new peer: Peer: permanent_uuid: "152b63a14a8d41dcbdd36729ef9f9e34" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:17.227141 30133 consensus_queue.cc:1035] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e932fa70769b4b20913f3d99209b6a39" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 32897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:17.230454 30137 mvcc.cc:205] Tried to move back new op lower bound from 7316164924313612288 to 7316164924260147200. Current Snapshot: MvccSnapshot[applied={T|T < 7316164924313612288}]
I20260808 07:11:17.231068 30136 mvcc.cc:205] Tried to move back new op lower bound from 7316164924313612288 to 7316164924260147200. Current Snapshot: MvccSnapshot[applied={T|T < 7316164924313612288}]
I20260808 07:11:17.234673 29613 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:11:17.234915 29613 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:11:17.235862 29613 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5b139227f95143d6ac9c3054d8395a4c: Sending DeleteTablet for 3 replicas of tablet 67b8fb8077d54c17bcd8cf4ffa59541e
I20260808 07:11:17.236276 30034 tablet_service.cc:1514] Processing DeleteTablet for tablet 67b8fb8077d54c17bcd8cf4ffa59541e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:17 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:44538
I20260808 07:11:17.236284 29752 tablet_service.cc:1514] Processing DeleteTablet for tablet 67b8fb8077d54c17bcd8cf4ffa59541e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:17 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:52488
I20260808 07:11:17.236312 29894 tablet_service.cc:1514] Processing DeleteTablet for tablet 67b8fb8077d54c17bcd8cf4ffa59541e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:17 UTC) from {username='kudu', principal='kudu/127.9.94.62@KRBTEST.COM'} at 127.0.0.1:40436
I20260808 07:11:17.236783 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 29685
I20260808 07:11:17.236943 30149 tablet_replica.cc:330] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34: stopping tablet replica
I20260808 07:11:17.237048 30149 raft_consensus.cc:2229] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:11:17.237154 30149 raft_consensus.cc:2258] T 67b8fb8077d54c17bcd8cf4ffa59541e P 152b63a14a8d41dcbdd36729ef9f9e34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:17.237448 30148 tablet_replica.cc:330] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39: stopping tablet replica
I20260808 07:11:17.237541 30148 raft_consensus.cc:2229] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:11:17.237620 30148 raft_consensus.cc:2258] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:17.237305 30150 tablet_replica.cc:330] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992: stopping tablet replica
I20260808 07:11:17.237762 30150 raft_consensus.cc:2229] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:11:17.237862 30150 raft_consensus.cc:2258] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:17.238369 30150 ts_tablet_manager.cc:1905] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:11:17.239085 30148 ts_tablet_manager.cc:1905] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:11:17.240438 30150 ts_tablet_manager.cc:1918] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:11:17.240515 30150 log.cc:1196] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/67b8fb8077d54c17bcd8cf4ffa59541e
I20260808 07:11:17.240804 30150 ts_tablet_manager.cc:1939] T 67b8fb8077d54c17bcd8cf4ffa59541e P e098470252dc413aad342e697a451992: Deleting consensus metadata
I20260808 07:11:17.241338 29597 catalog_manager.cc:4841] TS e098470252dc413aad342e697a451992 (127.9.94.2:39803): tablet 67b8fb8077d54c17bcd8cf4ffa59541e (table test-table [id=57aba19497f849eaaae66eb7885537cb]) successfully deleted
I20260808 07:11:17.241798 30148 ts_tablet_manager.cc:1918] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:11:17.241902 30148 log.cc:1196] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/67b8fb8077d54c17bcd8cf4ffa59541e
I20260808 07:11:17.242249 30148 ts_tablet_manager.cc:1939] T 67b8fb8077d54c17bcd8cf4ffa59541e P e932fa70769b4b20913f3d99209b6a39: Deleting consensus metadata
I20260808 07:11:17.246239 29596 catalog_manager.cc:4841] TS e932fa70769b4b20913f3d99209b6a39 (127.9.94.3:32897): tablet 67b8fb8077d54c17bcd8cf4ffa59541e (table test-table [id=57aba19497f849eaaae66eb7885537cb]) successfully deleted
W20260808 07:11:17.251598 29594 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:45279 (error 108)
I20260808 07:11:17.252250 30118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.252107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:45279 (local address 127.0.0.1:52490)
0808 07:11:17.252169 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:17.252208 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:45279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 07:11:17.252364 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 29828
W20260808 07:11:17.254053 29594 catalog_manager.cc:4584] TS 152b63a14a8d41dcbdd36729ef9f9e34 (127.9.94.1:45279): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 67b8fb8077d54c17bcd8cf4ffa59541e: Network error: Client connection negotiation failed: client connection to 127.9.94.1:45279: connect: Connection refused (error 111)
I20260808 07:11:17.258606 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 29968
I20260808 07:11:17.265044 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 29575
2026-08-08T07:11:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2198 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T07:11:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:17Z Disabled control of system clock
I20260808 07:11:17.298637 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36979
--webserver_interface=127.9.94.62
--webserver_port=0
--builtin_ntp_servers=127.9.94.20:39479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:36979
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:11:17.391743 30155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:17.391995 30155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:17.392021 30155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:17.393375 30155 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:17.393435 30155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:17.393448 30155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:17.393462 30155 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:17.393476 30155 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:17.394925 30155 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:39479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:36979
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30155
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:17.395146 30155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:17.395421 30155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:17.401036 30162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:17.401063 30164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:17.401063 30161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:17.401300 30155 server_base.cc:1034] running on GCE node
I20260808 07:11:17.401678 30155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:17.402225 30155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:17.403456 30155 hybrid_clock.cc:648] HybridClock initialized: now 1786173077403431 us; error 44 us; skew 500 ppm
I20260808 07:11:17.405335 30155 webserver.cc:460] Webserver started at http://127.9.94.62:38327/ using document root <none> and password file <none>
I20260808 07:11:17.405622 30155 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:17.405675 30155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:17.405818 30155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:17.407040 30155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "d1bae0b8bd9a4cf1beafbf57bbf6109a"
format_stamp: "Formatted at 2026-08-08 07:11:17 on dist-test-slave-77v9"
server_key: "4854341d0e81dfb49f5577e023d62e27"
server_key_iv: "75db9af60863675799ee66f0094e4c20"
server_key_version: "encryptionkey@0"
I20260808 07:11:17.407428 30155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "d1bae0b8bd9a4cf1beafbf57bbf6109a"
format_stamp: "Formatted at 2026-08-08 07:11:17 on dist-test-slave-77v9"
server_key: "4854341d0e81dfb49f5577e023d62e27"
server_key_iv: "75db9af60863675799ee66f0094e4c20"
server_key_version: "encryptionkey@0"
I20260808 07:11:17.409006 30155 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260808 07:11:17.410045 30170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:17.410321 30155 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:17.410466 30155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "d1bae0b8bd9a4cf1beafbf57bbf6109a"
format_stamp: "Formatted at 2026-08-08 07:11:17 on dist-test-slave-77v9"
server_key: "4854341d0e81dfb49f5577e023d62e27"
server_key_iv: "75db9af60863675799ee66f0094e4c20"
server_key_version: "encryptionkey@0"
I20260808 07:11:17.410557 30155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:17.422241 30155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:17.422776 30155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:17.422971 30155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:17.428422 30155 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:36979
I20260808 07:11:17.428455 30226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:36979 every 8 connection(s)
I20260808 07:11:17.428897 30155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:17.431520 30227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:17.434682 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 30155
I20260808 07:11:17.434835 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:17.435062 9592 external_mini_cluster.cc:1428] Setting key 627e1e3724abf59eb57f5dca09fc040d
I20260808 07:11:17.435547 30227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a: Bootstrap starting.
I20260808 07:11:17.436410 30227 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:17.436909 30227 log.cc:824] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:17.437748 30227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a: No bootstrap required, opened a new log
I20260808 07:11:17.439913 30227 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1bae0b8bd9a4cf1beafbf57bbf6109a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36979 } }
I20260808 07:11:17.440181 30227 raft_consensus.cc:374] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:17.440234 30227 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1bae0b8bd9a4cf1beafbf57bbf6109a, State: Initialized, Role: FOLLOWER
I20260808 07:11:17.440388 30227 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1bae0b8bd9a4cf1beafbf57bbf6109a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36979 } }
I20260808 07:11:17.440521 30227 raft_consensus.cc:388] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:17.440572 30227 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:17.440619 30227 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:17.441372 30227 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1bae0b8bd9a4cf1beafbf57bbf6109a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36979 } }
I20260808 07:11:17.441520 30227 leader_election.cc:302] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d1bae0b8bd9a4cf1beafbf57bbf6109a; no voters:
I20260808 07:11:17.441730 30227 leader_election.cc:288] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:17.441815 30232 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:17.441992 30232 raft_consensus.cc:686] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [term 1 LEADER]: Becoming Leader. State: Replica: d1bae0b8bd9a4cf1beafbf57bbf6109a, State: Running, Role: LEADER
I20260808 07:11:17.442091 30232 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1bae0b8bd9a4cf1beafbf57bbf6109a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36979 } }
I20260808 07:11:17.442123 30227 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:17.442329 30230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.435914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39950 (local address 127.9.94.62:36979)
0808 07:11:17.436186 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.436196 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.436236 (+ 40us) server_negotiation.cc:407] Connection header received
0808 07:11:17.436991 (+ 755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.437119 (+ 128us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.437222 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.437475 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:17.437754 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.438802 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.439704 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.440172 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.440335 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.441363 (+ 1028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:17.441367 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:17.441367 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:17.441606 (+ 239us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:17.441660 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:17.441675 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:17.441784 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.441955 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.442053 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":136,"threads_started":1}
I20260808 07:11:17.442446 30232 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d1bae0b8bd9a4cf1beafbf57bbf6109a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1bae0b8bd9a4cf1beafbf57bbf6109a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36979 } } }
I20260808 07:11:17.442523 30232 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:17.442648 30232 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1bae0b8bd9a4cf1beafbf57bbf6109a. Latest consensus state: current_term: 1 leader_uuid: "d1bae0b8bd9a4cf1beafbf57bbf6109a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1bae0b8bd9a4cf1beafbf57bbf6109a" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36979 } } }
I20260808 07:11:17.442711 30232 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:17.443506 30236 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:17.443981 30236 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:17.446099 30236 catalog_manager.cc:1347] Generated new cluster ID: 4a0eef2b734248f2a0ce6216f5ae4112
I20260808 07:11:17.446168 30236 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:17.472050 30236 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:17.472723 30236 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:17.478699 30236 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a: Generated new TSK 0
I20260808 07:11:17.479008 30236 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:17.487440 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.1:0
--local_ip_for_outbound_sockets=127.9.94.1
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36979
--builtin_ntp_servers=127.9.94.20:39479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:11:17.582798 30252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:17.583040 30252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:17.583065 30252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:17.584396 30252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:17.584446 30252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:17.584475 30252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.1
I20260808 07:11:17.585985 30252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:39479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.94.1
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36979
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.1
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:17.586251 30252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:17.586624 30252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:17.592434 30258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:17.592444 30252 server_base.cc:1034] running on GCE node
W20260808 07:11:17.592567 30257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:17.592710 30260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:17.593492 30252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:17.594084 30252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:17.595502 30252 hybrid_clock.cc:648] HybridClock initialized: now 1786173077595482 us; error 59 us; skew 500 ppm
I20260808 07:11:17.597254 30252 webserver.cc:460] Webserver started at http://127.9.94.1:44099/ using document root <none> and password file <none>
I20260808 07:11:17.597590 30252 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:17.597651 30252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:17.597808 30252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:17.599067 30252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/data/instance:
uuid: "ac1b53b2a28543e6b3d581af9a799461"
format_stamp: "Formatted at 2026-08-08 07:11:17 on dist-test-slave-77v9"
server_key: "95945be599d3f58a7d4649e088f4ebba"
server_key_iv: "76fbfe04dd1844377d2aca3022b3e547"
server_key_version: "encryptionkey@0"
I20260808 07:11:17.599496 30252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance:
uuid: "ac1b53b2a28543e6b3d581af9a799461"
format_stamp: "Formatted at 2026-08-08 07:11:17 on dist-test-slave-77v9"
server_key: "95945be599d3f58a7d4649e088f4ebba"
server_key_iv: "76fbfe04dd1844377d2aca3022b3e547"
server_key_version: "encryptionkey@0"
I20260808 07:11:17.601244 30252 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260808 07:11:17.602376 30266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:17.603221 30252 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:17.603335 30252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/wal
uuid: "ac1b53b2a28543e6b3d581af9a799461"
format_stamp: "Formatted at 2026-08-08 07:11:17 on dist-test-slave-77v9"
server_key: "95945be599d3f58a7d4649e088f4ebba"
server_key_iv: "76fbfe04dd1844377d2aca3022b3e547"
server_key_version: "encryptionkey@0"
I20260808 07:11:17.603437 30252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:17.626369 30252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:17.626727 30252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:17.627313 30252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:17.627599 30252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:17.628063 30252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:17.628103 30252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:17.628127 30252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:17.628139 30252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:17.634490 30252 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.1:38617
I20260808 07:11:17.634622 30386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.1:38617 every 8 connection(s)
I20260808 07:11:17.635197 30252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/data/info.pb
I20260808 07:11:17.641794 30230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.636343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:51617 (local address 127.9.94.62:36979)
0808 07:11:17.636519 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.636523 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.636739 (+ 216us) server_negotiation.cc:407] Connection header received
0808 07:11:17.637385 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.637387 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.637401 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.637471 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:17.638342 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.638922 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.640049 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.640279 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.640383 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.641463 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:17.641465 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:17.641465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:17.641471 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:17.641490 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:17.641495 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:17.641551 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.641665 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.641697 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260808 07:11:17.642076 30390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.636235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36979 (local address 127.9.94.1:51617)
0808 07:11:17.636580 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:17.636633 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:17.637258 (+ 625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:17.637560 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:17.637567 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:17.637582 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:17.638229 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.638234 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.639046 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.639047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.639942 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.639944 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.640396 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.640397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.640563 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.641271 (+ 708us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:11:17.641271 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:17.641305 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:11:17.641331 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:17.641553 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:17.641560 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:17.641564 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:11:17.641666 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 07:11:17.641787 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":130,"threads_started":1}
I20260808 07:11:17.642717 30387 heartbeater.cc:347] Connected to a master server at 127.9.94.62:36979
I20260808 07:11:17.642810 30387 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:17.643091 30387 heartbeater.cc:511] Master 127.9.94.62:36979 requested a full tablet report, sending...
I20260808 07:11:17.643734 30188 ts_manager.cc:194] Registered new tserver with Master: ac1b53b2a28543e6b3d581af9a799461 (127.9.94.1:38617)
I20260808 07:11:17.644598 30188 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.94.1:51617
I20260808 07:11:17.645283 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 30252
I20260808 07:11:17.645519 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-0/wal/instance
I20260808 07:11:17.645794 9592 external_mini_cluster.cc:1428] Setting key bfbe71cfb3f9dfa0576c63caa2dec190
I20260808 07:11:17.647105 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.2:0
--local_ip_for_outbound_sockets=127.9.94.2
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36979
--builtin_ntp_servers=127.9.94.20:39479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:11:17.739248 30392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:17.739547 30392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:17.739588 30392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:17.741016 30392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:17.741110 30392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:17.741163 30392 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.2
I20260808 07:11:17.742918 30392 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:39479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.94.2
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36979
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.2
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:17.743255 30392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:17.743651 30392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:17.749405 30397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:17.749431 30398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:17.749431 30400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:17.750722 30392 server_base.cc:1034] running on GCE node
I20260808 07:11:17.751051 30392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:17.751302 30392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:17.752509 30392 hybrid_clock.cc:648] HybridClock initialized: now 1786173077752487 us; error 57 us; skew 500 ppm
I20260808 07:11:17.754197 30392 webserver.cc:460] Webserver started at http://127.9.94.2:44469/ using document root <none> and password file <none>
I20260808 07:11:17.754530 30392 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:17.754616 30392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:17.754798 30392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:17.756031 30392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/data/instance:
uuid: "b429853db83d4424a0683df3ac9e47ce"
format_stamp: "Formatted at 2026-08-08 07:11:17 on dist-test-slave-77v9"
server_key: "c6387b16f17b70c75220d3a5a7f17d0b"
server_key_iv: "b120b4be9700d89dab110031cfe1d137"
server_key_version: "encryptionkey@0"
I20260808 07:11:17.756498 30392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance:
uuid: "b429853db83d4424a0683df3ac9e47ce"
format_stamp: "Formatted at 2026-08-08 07:11:17 on dist-test-slave-77v9"
server_key: "c6387b16f17b70c75220d3a5a7f17d0b"
server_key_iv: "b120b4be9700d89dab110031cfe1d137"
server_key_version: "encryptionkey@0"
I20260808 07:11:17.758253 30392 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260808 07:11:17.759235 30407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:17.759454 30392 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:11:17.759574 30392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/wal
uuid: "b429853db83d4424a0683df3ac9e47ce"
format_stamp: "Formatted at 2026-08-08 07:11:17 on dist-test-slave-77v9"
server_key: "c6387b16f17b70c75220d3a5a7f17d0b"
server_key_iv: "b120b4be9700d89dab110031cfe1d137"
server_key_version: "encryptionkey@0"
I20260808 07:11:17.759672 30392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:17.775259 30392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:17.775651 30392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:17.775820 30392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:17.776247 30392 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:17.776865 30392 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:17.776948 30392 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:17.777001 30392 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:17.777033 30392 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:17.784154 30392 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.2:36341
I20260808 07:11:17.784212 30527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.2:36341 every 8 connection(s)
I20260808 07:11:17.784732 30392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/data/info.pb
I20260808 07:11:17.792658 30230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.786514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.2:36135 (local address 127.9.94.62:36979)
0808 07:11:17.786585 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.786587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.786606 (+ 19us) server_negotiation.cc:407] Connection header received
0808 07:11:17.787485 (+ 879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.787487 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.787500 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.787579 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:17.788640 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.789562 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.790720 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.790962 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.791032 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.792180 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:17.792189 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:17.792189 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:17.792198 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:17.792226 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:17.792232 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:17.792336 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.792553 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.792582 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 07:11:17.793040 30530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.786206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36979 (local address 127.9.94.2:36135)
0808 07:11:17.786489 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:17.786536 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:17.787329 (+ 793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:17.787739 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:17.787743 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:17.787753 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:17.788414 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.788421 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.789674 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.789675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.790575 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.790577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.791071 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.791072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.791235 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.791936 (+ 701us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:11:17.791937 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:17.791971 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:11:17.791998 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:17.792377 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:17.792384 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:17.792387 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:11:17.792479 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 07:11:17.792592 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":89,"threads_started":1}
I20260808 07:11:17.794126 30528 heartbeater.cc:347] Connected to a master server at 127.9.94.62:36979
I20260808 07:11:17.794371 30528 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:17.794625 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 30392
I20260808 07:11:17.794682 30528 heartbeater.cc:511] Master 127.9.94.62:36979 requested a full tablet report, sending...
I20260808 07:11:17.794742 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/wal/instance
I20260808 07:11:17.795051 9592 external_mini_cluster.cc:1428] Setting key ec12513cdb515aed780af98f8ddb5721
I20260808 07:11:17.795440 30188 ts_manager.cc:194] Registered new tserver with Master: b429853db83d4424a0683df3ac9e47ce (127.9.94.2:36341)
I20260808 07:11:17.796224 30188 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.94.2:36135
I20260808 07:11:17.796584 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.94.3:0
--local_ip_for_outbound_sockets=127.9.94.3
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36979
--builtin_ntp_servers=127.9.94.20:39479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:11:17.893440 30531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:17.893676 30531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:17.893702 30531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:17.895011 30531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:17.895069 30531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:17.895098 30531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.94.3
I20260808 07:11:17.896564 30531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:39479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.94.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.94.3
--webserver_port=0
--tserver_master_addrs=127.9.94.62:36979
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.94.3
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:17.896879 30531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:17.897224 30531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:17.903386 30538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:17.903388 30537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:17.903388 30540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:17.903717 30531 server_base.cc:1034] running on GCE node
I20260808 07:11:17.904006 30531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:17.904313 30531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:17.905500 30531 hybrid_clock.cc:648] HybridClock initialized: now 1786173077905470 us; error 56 us; skew 500 ppm
I20260808 07:11:17.907536 30531 webserver.cc:460] Webserver started at http://127.9.94.3:41059/ using document root <none> and password file <none>
I20260808 07:11:17.908016 30531 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:17.908085 30531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:17.908246 30531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:17.909752 30531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/data/instance:
uuid: "0ec4000d85754430a133f2804d55b74c"
format_stamp: "Formatted at 2026-08-08 07:11:17 on dist-test-slave-77v9"
server_key: "c9d270e9ad2ec39f58c333af278d780c"
server_key_iv: "6f12c37e0c39e451534d54d4916535c3"
server_key_version: "encryptionkey@0"
I20260808 07:11:17.910213 30531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance:
uuid: "0ec4000d85754430a133f2804d55b74c"
format_stamp: "Formatted at 2026-08-08 07:11:17 on dist-test-slave-77v9"
server_key: "c9d270e9ad2ec39f58c333af278d780c"
server_key_iv: "6f12c37e0c39e451534d54d4916535c3"
server_key_version: "encryptionkey@0"
I20260808 07:11:17.911767 30531 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:11:17.912787 30547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:17.913100 30531 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:17.913215 30531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/wal
uuid: "0ec4000d85754430a133f2804d55b74c"
format_stamp: "Formatted at 2026-08-08 07:11:17 on dist-test-slave-77v9"
server_key: "c9d270e9ad2ec39f58c333af278d780c"
server_key_iv: "6f12c37e0c39e451534d54d4916535c3"
server_key_version: "encryptionkey@0"
I20260808 07:11:17.913309 30531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:17.934643 30531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:17.935061 30531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:17.935250 30531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:17.935532 30531 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:11:17.935950 30531 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:11:17.935992 30531 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:17.936018 30531 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:11:17.936033 30531 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:17.943061 30531 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.3:39153
I20260808 07:11:17.943113 30673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.3:39153 every 8 connection(s)
I20260808 07:11:17.943572 30531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/data/info.pb
I20260808 07:11:17.944330 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 30531
I20260808 07:11:17.944464 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/wal/instance
I20260808 07:11:17.944682 9592 external_mini_cluster.cc:1428] Setting key e3f85ac38704e9b572e919850da75226
I20260808 07:11:17.950377 30230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.944457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.3:43287 (local address 127.9.94.62:36979)
0808 07:11:17.944878 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.944880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.944893 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:11:17.945747 (+ 854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.945748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.945761 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.945813 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:17.946765 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.947434 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.948596 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.948866 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.948931 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.950006 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:17.950007 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:17.950008 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:17.950021 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:17.950043 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:17.950048 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:17.950120 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.950240 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.950271 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394}
I20260808 07:11:17.950660 30676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.944444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36979 (local address 127.9.94.3:43287)
0808 07:11:17.944653 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:17.944701 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:17.945615 (+ 914us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:17.945897 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:17.945912 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:17.945922 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:17.946604 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.946610 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.947656 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.947657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.948495 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.948497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.948958 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.948959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.949095 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.949696 (+ 601us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:11:17.949697 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:17.949731 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:11:17.949758 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:17.950122 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:17.950129 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:17.950133 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:11:17.950228 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 07:11:17.950353 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":98,"threads_started":1}
I20260808 07:11:17.951344 30674 heartbeater.cc:347] Connected to a master server at 127.9.94.62:36979
I20260808 07:11:17.951462 30674 heartbeater.cc:464] Registering TS with master...
I20260808 07:11:17.951691 30674 heartbeater.cc:511] Master 127.9.94.62:36979 requested a full tablet report, sending...
I20260808 07:11:17.952246 30188 ts_manager.cc:194] Registered new tserver with Master: 0ec4000d85754430a133f2804d55b74c (127.9.94.3:39153)
I20260808 07:11:17.952751 30188 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.94.3:43287
I20260808 07:11:17.957077 9592 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:11:17.962479 30230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.958896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39954 (local address 127.9.94.62:36979)
0808 07:11:17.958978 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.958980 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.959217 (+ 237us) server_negotiation.cc:407] Connection header received
0808 07:11:17.959246 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.959247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.959259 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.959319 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:17.959567 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.960123 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.960989 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.961203 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.961270 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.962146 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:17.962147 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:17.962148 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:17.962152 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:17.962166 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:17.962170 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:17.962224 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.962367 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.962396 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 07:11:17.964920 30188 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39954:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:11:17.966566 30188 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:11:17.973795 30683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.969078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:39153 (local address 127.0.0.1:36762)
0808 07:11:17.969303 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:17.969347 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:17.969425 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:17.969868 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:17.969872 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:17.969874 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:17.969984 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.969988 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.971025 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.971027 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.972467 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.972471 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.973445 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.973446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.973534 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.973549 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 07:11:17.973637 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 07:11:17.973701 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":3,"thread_start_us":96,"threads_started":1}
I20260808 07:11:17.973806 30687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.969153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36762 (local address 127.9.94.3:39153)
0808 07:11:17.969620 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.969627 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.969639 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:11:17.969683 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.969686 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.969704 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.969784 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:17.970079 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.970923 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.972577 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.973321 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.973437 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.973553 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.973653 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.973698 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":88,"threads_started":1}
I20260808 07:11:17.974267 30686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.969080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:36341 (local address 127.0.0.1:54412)
0808 07:11:17.969406 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:17.969416 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:17.969470 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:17.969868 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:17.969872 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:17.969877 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:17.969984 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.969987 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.971573 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.971574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.972775 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.972778 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.974031 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.974032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.974096 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.974101 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:11:17.974133 (+ 32us) client_negotiation.cc:240] Negotiation successful
0808 07:11:17.974173 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":26,"thread_start_us":92,"threads_started":1}
I20260808 07:11:17.974587 30682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.969080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:38617 (local address 127.0.0.1:35938)
0808 07:11:17.969392 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:17.969404 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:17.969470 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:17.969973 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:17.969974 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:17.969977 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:17.970046 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.970049 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.971671 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.971672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.973313 (+ 1641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:17.973316 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.974326 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.974327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:17.974401 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.974406 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:11:17.974467 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 07:11:17.974520 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":85,"threads_started":1}
I20260808 07:11:17.974617 30690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.969574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35938 (local address 127.9.94.1:38617)
0808 07:11:17.969791 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.969796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.969806 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:11:17.969847 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.969849 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.969864 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.970134 (+ 270us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:17.970197 (+ 63us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.971525 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.973431 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.974213 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.974316 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.974412 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.974480 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.974524 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":112,"threads_started":1}
I20260808 07:11:17.975075 30688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:17.969378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54412 (local address 127.9.94.2:36341)
0808 07:11:17.969630 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:17.969634 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:17.969642 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:11:17.969678 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:17.969679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:17.969719 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:17.970136 (+ 417us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:17.970200 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.971464 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.972930 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:17.973911 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:17.974738 (+ 827us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:17.974920 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:17.974947 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 07:11:17.974992 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":89,"threads_started":1}
I20260808 07:11:17.974978 30604 tablet_service.cc:1467] Processing CreateTablet for tablet ee8e04873e8044d699e57d2756a8eaa2 (DEFAULT_TABLE table=test-table [id=7e2f97fc0b824aedb40e8eac94707a13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:17.975262 30317 tablet_service.cc:1467] Processing CreateTablet for tablet ee8e04873e8044d699e57d2756a8eaa2 (DEFAULT_TABLE table=test-table [id=7e2f97fc0b824aedb40e8eac94707a13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:17.975423 30604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee8e04873e8044d699e57d2756a8eaa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:17.975623 30317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee8e04873e8044d699e57d2756a8eaa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:17.975666 30456 tablet_service.cc:1467] Processing CreateTablet for tablet ee8e04873e8044d699e57d2756a8eaa2 (DEFAULT_TABLE table=test-table [id=7e2f97fc0b824aedb40e8eac94707a13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:11:17.975973 30456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee8e04873e8044d699e57d2756a8eaa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:17.978921 30691 tablet_bootstrap.cc:492] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c: Bootstrap starting.
I20260808 07:11:17.979377 30692 tablet_bootstrap.cc:492] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461: Bootstrap starting.
I20260808 07:11:17.979755 30691 tablet_bootstrap.cc:654] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:17.980069 30692 tablet_bootstrap.cc:654] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:17.980077 30691 log.cc:824] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:17.980384 30692 log.cc:824] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:17.980767 30693 tablet_bootstrap.cc:492] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce: Bootstrap starting.
I20260808 07:11:17.980880 30691 tablet_bootstrap.cc:492] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c: No bootstrap required, opened a new log
I20260808 07:11:17.980962 30691 ts_tablet_manager.cc:1397] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:11:17.981407 30693 tablet_bootstrap.cc:654] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:17.981707 30693 log.cc:824] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:17.982282 30692 tablet_bootstrap.cc:492] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461: No bootstrap required, opened a new log
I20260808 07:11:17.982376 30692 ts_tablet_manager.cc:1397] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 07:11:17.982496 30693 tablet_bootstrap.cc:492] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce: No bootstrap required, opened a new log
I20260808 07:11:17.982571 30693 ts_tablet_manager.cc:1397] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:11:17.983630 30691 raft_consensus.cc:348] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec4000d85754430a133f2804d55b74c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 39153 } } peers { permanent_uuid: "b429853db83d4424a0683df3ac9e47ce" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36341 } } peers { permanent_uuid: "ac1b53b2a28543e6b3d581af9a799461" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38617 } }
I20260808 07:11:17.983817 30691 raft_consensus.cc:374] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:17.983856 30691 raft_consensus.cc:729] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec4000d85754430a133f2804d55b74c, State: Initialized, Role: FOLLOWER
I20260808 07:11:17.983981 30691 consensus_queue.cc:260] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec4000d85754430a133f2804d55b74c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 39153 } } peers { permanent_uuid: "b429853db83d4424a0683df3ac9e47ce" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36341 } } peers { permanent_uuid: "ac1b53b2a28543e6b3d581af9a799461" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38617 } }
I20260808 07:11:17.984265 30691 ts_tablet_manager.cc:1428] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:11:17.984302 30674 heartbeater.cc:503] Master 127.9.94.62:36979 was elected leader, sending a full tablet report...
I20260808 07:11:17.984977 30692 raft_consensus.cc:348] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec4000d85754430a133f2804d55b74c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 39153 } } peers { permanent_uuid: "b429853db83d4424a0683df3ac9e47ce" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36341 } } peers { permanent_uuid: "ac1b53b2a28543e6b3d581af9a799461" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38617 } }
I20260808 07:11:17.985134 30692 raft_consensus.cc:374] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:17.985174 30692 raft_consensus.cc:729] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1b53b2a28543e6b3d581af9a799461, State: Initialized, Role: FOLLOWER
I20260808 07:11:17.985180 30693 raft_consensus.cc:348] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec4000d85754430a133f2804d55b74c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 39153 } } peers { permanent_uuid: "b429853db83d4424a0683df3ac9e47ce" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36341 } } peers { permanent_uuid: "ac1b53b2a28543e6b3d581af9a799461" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38617 } }
I20260808 07:11:17.985359 30693 raft_consensus.cc:374] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:17.985318 30692 consensus_queue.cc:260] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec4000d85754430a133f2804d55b74c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 39153 } } peers { permanent_uuid: "b429853db83d4424a0683df3ac9e47ce" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36341 } } peers { permanent_uuid: "ac1b53b2a28543e6b3d581af9a799461" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38617 } }
I20260808 07:11:17.985397 30693 raft_consensus.cc:729] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b429853db83d4424a0683df3ac9e47ce, State: Initialized, Role: FOLLOWER
I20260808 07:11:17.985524 30693 consensus_queue.cc:260] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec4000d85754430a133f2804d55b74c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 39153 } } peers { permanent_uuid: "b429853db83d4424a0683df3ac9e47ce" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36341 } } peers { permanent_uuid: "ac1b53b2a28543e6b3d581af9a799461" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38617 } }
I20260808 07:11:17.985641 30692 ts_tablet_manager.cc:1428] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 07:11:17.985769 30693 ts_tablet_manager.cc:1428] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 07:11:17.985913 30528 heartbeater.cc:503] Master 127.9.94.62:36979 was elected leader, sending a full tablet report...
I20260808 07:11:17.986191 30387 heartbeater.cc:503] Master 127.9.94.62:36979 was elected leader, sending a full tablet report...
W20260808 07:11:18.035851 30529 tablet.cc:2369] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:11:18.136155 30388 tablet.cc:2369] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:11:18.194325 30675 tablet.cc:2369] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:11:18.220752 30698 raft_consensus.cc:482] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:11:18.220988 30698 raft_consensus.cc:504] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec4000d85754430a133f2804d55b74c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 39153 } } peers { permanent_uuid: "b429853db83d4424a0683df3ac9e47ce" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36341 } } peers { permanent_uuid: "ac1b53b2a28543e6b3d581af9a799461" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38617 } }
I20260808 07:11:18.221539 30698 leader_election.cc:288] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec4000d85754430a133f2804d55b74c (127.9.94.3:39153), b429853db83d4424a0683df3ac9e47ce (127.9.94.2:36341)
I20260808 07:11:18.226117 30687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:18.221966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:35105 (local address 127.9.94.3:39153)
0808 07:11:18.222016 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:18.222018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:18.222352 (+ 334us) server_negotiation.cc:407] Connection header received
0808 07:11:18.222473 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:18.222474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:18.222484 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:18.222536 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:18.222714 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:18.223648 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:18.225328 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:18.225700 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:18.225737 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:18.225745 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:18.225986 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 07:11:18.226039 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:11:18.226125 30701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:18.221885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.3:39153 (local address 127.9.94.1:35105)
0808 07:11:18.222255 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:18.222268 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:18.222357 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:18.222552 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:18.222552 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:18.222554 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:18.222634 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:18.222642 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:18.223768 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:18.223769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:18.225212 (+ 1443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:18.225214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:18.225797 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:18.225797 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:18.225856 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:18.225859 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:11:18.225962 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 07:11:18.226014 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":68,"threads_started":1}
I20260808 07:11:18.226621 30624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee8e04873e8044d699e57d2756a8eaa2" candidate_uuid: "ac1b53b2a28543e6b3d581af9a799461" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec4000d85754430a133f2804d55b74c" is_pre_election: true
I20260808 07:11:18.226824 30624 raft_consensus.cc:2454] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1b53b2a28543e6b3d581af9a799461 in term 0.
I20260808 07:11:18.227094 30269 leader_election.cc:302] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec4000d85754430a133f2804d55b74c, ac1b53b2a28543e6b3d581af9a799461; no voters:
I20260808 07:11:18.227268 30698 raft_consensus.cc:2781] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:11:18.227355 30698 raft_consensus.cc:482] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:11:18.227437 30698 raft_consensus.cc:3037] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:18.228430 30688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:18.222186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.94.1:33007 (local address 127.9.94.2:36341)
0808 07:11:18.222243 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:18.222245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:18.224994 (+ 2749us) server_negotiation.cc:407] Connection header received
0808 07:11:18.225078 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:18.225079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:18.225094 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:18.225151 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:11:18.225363 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:18.226174 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:18.227488 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:18.228016 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:18.228067 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:18.228079 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:18.228322 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 07:11:18.228363 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:11:18.228442 30700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:18.222101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.2:36341 (local address 127.9.94.1:33007)
0808 07:11:18.224913 (+ 2812us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:18.224925 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:18.225017 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:18.225201 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:18.225202 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:18.225204 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:11:18.225271 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:18.225273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:18.226259 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:18.226260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:18.227381 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:18.227383 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:18.228162 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:18.228163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:18.228236 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:18.228239 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:11:18.228315 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 07:11:18.228356 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2784,"thread_start_us":51,"threads_started":1}
I20260808 07:11:18.228513 30698 raft_consensus.cc:504] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec4000d85754430a133f2804d55b74c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 39153 } } peers { permanent_uuid: "b429853db83d4424a0683df3ac9e47ce" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36341 } } peers { permanent_uuid: "ac1b53b2a28543e6b3d581af9a799461" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38617 } }
I20260808 07:11:18.228667 30698 leader_election.cc:288] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [CANDIDATE]: Term 1 election: Requested vote from peers 0ec4000d85754430a133f2804d55b74c (127.9.94.3:39153), b429853db83d4424a0683df3ac9e47ce (127.9.94.2:36341)
I20260808 07:11:18.228874 30624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee8e04873e8044d699e57d2756a8eaa2" candidate_uuid: "ac1b53b2a28543e6b3d581af9a799461" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec4000d85754430a133f2804d55b74c"
I20260808 07:11:18.228978 30624 raft_consensus.cc:3037] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:18.229199 30478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee8e04873e8044d699e57d2756a8eaa2" candidate_uuid: "ac1b53b2a28543e6b3d581af9a799461" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b429853db83d4424a0683df3ac9e47ce" is_pre_election: true
I20260808 07:11:18.229421 30478 raft_consensus.cc:2454] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1b53b2a28543e6b3d581af9a799461 in term 0.
I20260808 07:11:18.229589 30477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee8e04873e8044d699e57d2756a8eaa2" candidate_uuid: "ac1b53b2a28543e6b3d581af9a799461" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b429853db83d4424a0683df3ac9e47ce"
I20260808 07:11:18.229669 30477 raft_consensus.cc:3037] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:18.230059 30624 raft_consensus.cc:2454] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1b53b2a28543e6b3d581af9a799461 in term 1.
I20260808 07:11:18.230261 30269 leader_election.cc:302] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec4000d85754430a133f2804d55b74c, ac1b53b2a28543e6b3d581af9a799461; no voters:
I20260808 07:11:18.230387 30698 raft_consensus.cc:2781] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:18.230558 30698 raft_consensus.cc:686] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [term 1 LEADER]: Becoming Leader. State: Replica: ac1b53b2a28543e6b3d581af9a799461, State: Running, Role: LEADER
I20260808 07:11:18.230674 30698 consensus_queue.cc:237] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec4000d85754430a133f2804d55b74c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 39153 } } peers { permanent_uuid: "b429853db83d4424a0683df3ac9e47ce" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36341 } } peers { permanent_uuid: "ac1b53b2a28543e6b3d581af9a799461" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38617 } }
I20260808 07:11:18.230782 30477 raft_consensus.cc:2454] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1b53b2a28543e6b3d581af9a799461 in term 1.
I20260808 07:11:18.231627 30188 catalog_manager.cc:5495] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1b53b2a28543e6b3d581af9a799461 (127.9.94.1). New cstate: current_term: 1 leader_uuid: "ac1b53b2a28543e6b3d581af9a799461" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec4000d85754430a133f2804d55b74c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b429853db83d4424a0683df3ac9e47ce" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1b53b2a28543e6b3d581af9a799461" member_type: VOTER last_known_addr { host: "127.9.94.1" port: 38617 } health_report { overall_health: HEALTHY } } }
I20260808 07:11:18.264114 30690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:18.261135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35952 (local address 127.9.94.1:38617)
0808 07:11:18.261188 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:18.261191 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:18.261200 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:11:18.261302 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:18.261303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:18.261416 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:18.261554 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:18.261704 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:18.262284 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:18.263215 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:18.263443 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:18.263533 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:18.263715 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:18.263831 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:18.263932 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:18.263952 (+ 20us) server_negotiation.cc:299] Negotiation successful
0808 07:11:18.263974 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:11:18.266487 30477 raft_consensus.cc:1261] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce [term 1 FOLLOWER]: Refusing update from remote peer ac1b53b2a28543e6b3d581af9a799461: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:18.266660 30624 raft_consensus.cc:1261] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c [term 1 FOLLOWER]: Refusing update from remote peer ac1b53b2a28543e6b3d581af9a799461: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:18.266904 30698 consensus_queue.cc:1035] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b429853db83d4424a0683df3ac9e47ce" member_type: VOTER last_known_addr { host: "127.9.94.2" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:18.267064 30702 consensus_queue.cc:1035] T ee8e04873e8044d699e57d2756a8eaa2 P ac1b53b2a28543e6b3d581af9a799461 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec4000d85754430a133f2804d55b74c" member_type: VOTER last_known_addr { host: "127.9.94.3" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:18.269924 30705 mvcc.cc:205] Tried to move back new op lower bound from 7316164928576258048 to 7316164928433680384. Current Snapshot: MvccSnapshot[applied={T|T < 7316164928576258048}]
I20260808 07:11:18.270815 30707 mvcc.cc:205] Tried to move back new op lower bound from 7316164928576258048 to 7316164928433680384. Current Snapshot: MvccSnapshot[applied={T|T < 7316164928576258048}]
I20260808 07:11:18.271222 30706 mvcc.cc:205] Tried to move back new op lower bound from 7316164928576258048 to 7316164928433680384. Current Snapshot: MvccSnapshot[applied={T|T < 7316164928576258048}]
I20260808 07:11:18.272567 30188 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:11:18.272692 30188 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39954:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:11:18.273620 30188 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d1bae0b8bd9a4cf1beafbf57bbf6109a: Sending DeleteTablet for 3 replicas of tablet ee8e04873e8044d699e57d2756a8eaa2
I20260808 07:11:18.274026 30456 tablet_service.cc:1514] Processing DeleteTablet for tablet ee8e04873e8044d699e57d2756a8eaa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:18 UTC) from {username='slave'} at 127.0.0.1:54412
I20260808 07:11:18.274101 30604 tablet_service.cc:1514] Processing DeleteTablet for tablet ee8e04873e8044d699e57d2756a8eaa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:18 UTC) from {username='slave'} at 127.0.0.1:36762
I20260808 07:11:18.274295 30715 tablet_replica.cc:330] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce: stopping tablet replica
I20260808 07:11:18.274336 30716 tablet_replica.cc:330] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c: stopping tablet replica
I20260808 07:11:18.274417 30715 raft_consensus.cc:2229] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:11:18.274433 30716 raft_consensus.cc:2229] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:11:18.274529 30716 raft_consensus.cc:2258] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:18.274529 30715 raft_consensus.cc:2258] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:11:18.274822 30317 tablet_service.cc:1514] Processing DeleteTablet for tablet ee8e04873e8044d699e57d2756a8eaa2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:11:18 UTC) from {username='slave'} at 127.0.0.1:35938
I20260808 07:11:18.275023 30715 ts_tablet_manager.cc:1905] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:11:18.275309 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 30252
I20260808 07:11:18.275348 30716 ts_tablet_manager.cc:1905] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:11:18.277122 30716 ts_tablet_manager.cc:1918] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:11:18.277217 30716 log.cc:1196] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-2/wal/wals/ee8e04873e8044d699e57d2756a8eaa2
I20260808 07:11:18.277341 30715 ts_tablet_manager.cc:1918] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:11:18.277441 30715 log.cc:1196] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce: Deleting WAL directory at /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172813832116-9592-0/minicluster-data/ts-1/wal/wals/ee8e04873e8044d699e57d2756a8eaa2
I20260808 07:11:18.277522 30716 ts_tablet_manager.cc:1939] T ee8e04873e8044d699e57d2756a8eaa2 P 0ec4000d85754430a133f2804d55b74c: Deleting consensus metadata
I20260808 07:11:18.277747 30715 ts_tablet_manager.cc:1939] T ee8e04873e8044d699e57d2756a8eaa2 P b429853db83d4424a0683df3ac9e47ce: Deleting consensus metadata
I20260808 07:11:18.277945 30172 catalog_manager.cc:4841] TS 0ec4000d85754430a133f2804d55b74c (127.9.94.3:39153): tablet ee8e04873e8044d699e57d2756a8eaa2 (table test-table [id=7e2f97fc0b824aedb40e8eac94707a13]) successfully deleted
I20260808 07:11:18.278159 30173 catalog_manager.cc:4841] TS b429853db83d4424a0683df3ac9e47ce (127.9.94.2:36341): tablet ee8e04873e8044d699e57d2756a8eaa2 (table test-table [id=7e2f97fc0b824aedb40e8eac94707a13]) successfully deleted
W20260808 07:11:18.287672 30174 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.94.1:38617 (error 108)
I20260808 07:11:18.287976 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 30392
I20260808 07:11:18.289333 30682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:18.288182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.1:38617 (local address 127.0.0.1:35966)
0808 07:11:18.289221 (+ 1039us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:18.289280 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.1:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":947}
W20260808 07:11:18.290491 30174 catalog_manager.cc:4584] TS ac1b53b2a28543e6b3d581af9a799461 (127.9.94.1:38617): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ee8e04873e8044d699e57d2756a8eaa2: Network error: Client connection negotiation failed: client connection to 127.9.94.1:38617: connect: Connection refused (error 111)
I20260808 07:11:18.297353 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 30531
I20260808 07:11:18.303915 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 30155
2026-08-08T07:11:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1040 ms)
[----------] 6 tests from EncryptionPolicyTest (9814 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:18 dist-test-slave-77v9 krb5kdc[30721](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:18 dist-test-slave-77v9 krb5kdc[30721](info): set up 2 sockets
Aug 08 07:11:18 dist-test-slave-77v9 krb5kdc[30721](info): commencing operation
krb5kdc: starting...
W20260808 07:11:19.483361 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:19 dist-test-slave-77v9 krb5kdc[30721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:11:19.650043 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34797
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34797
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:19.744371 30736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:19.744622 30736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:19.744649 30736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:19.745980 30736 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:19.746035 30736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:19.746049 30736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:19.746062 30736 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:19.746074 30736 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:19.747946 30736 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34797
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30736
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:19.748256 30736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:19.748550 30736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:19.754254 30742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:19.754254 30744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:19.754621 30736 server_base.cc:1034] running on GCE node
W20260808 07:11:19.754295 30741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:19.755189 30736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:19.755553 30736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:19.756763 30736 hybrid_clock.cc:648] HybridClock initialized: now 1786173079756727 us; error 81 us; skew 500 ppm
Aug 08 07:11:19 dist-test-slave-77v9 krb5kdc[30721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173079, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:19.760052 30736 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:11:19.760694 30736 webserver.cc:460] Webserver started at http://127.0.0.1:34055/ using document root <none> and password file <none>
I20260808 07:11:19.761034 30736 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:19.761118 30736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:19.761296 30736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:19.762506 30736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "8b8e6de0d4604989bd997f7b70950166"
format_stamp: "Formatted at 2026-08-08 07:11:19 on dist-test-slave-77v9"
server_key: "a560fe3cb7542bbcc10382fbc9d2fdf9"
server_key_iv: "3292c45cfb194f1b5be0c027042d36dc"
server_key_version: "encryptionkey@0"
I20260808 07:11:19.762910 30736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "8b8e6de0d4604989bd997f7b70950166"
format_stamp: "Formatted at 2026-08-08 07:11:19 on dist-test-slave-77v9"
server_key: "a560fe3cb7542bbcc10382fbc9d2fdf9"
server_key_iv: "3292c45cfb194f1b5be0c027042d36dc"
server_key_version: "encryptionkey@0"
I20260808 07:11:19.764597 30736 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:11:19.765637 30751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:19.765964 30736 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:19.766093 30736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "8b8e6de0d4604989bd997f7b70950166"
format_stamp: "Formatted at 2026-08-08 07:11:19 on dist-test-slave-77v9"
server_key: "a560fe3cb7542bbcc10382fbc9d2fdf9"
server_key_iv: "3292c45cfb194f1b5be0c027042d36dc"
server_key_version: "encryptionkey@0"
I20260808 07:11:19.766177 30736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:19.781030 30736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:19.783655 30736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:19.783856 30736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:19.789795 30736 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34797
I20260808 07:11:19.789891 30807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34797 every 8 connection(s)
I20260808 07:11:19.790292 30736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:19.791426 30808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:19.794200 30808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166: Bootstrap starting.
I20260808 07:11:19.794799 30808 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:19.795066 30808 log.cc:824] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:19.795894 30808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166: No bootstrap required, opened a new log
I20260808 07:11:19.797572 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 30736
I20260808 07:11:19.797715 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:19.797928 9592 external_mini_cluster.cc:1428] Setting key 8f4ad4169d7e0196eb29a8d1e3f8d7d3
I20260808 07:11:19.797663 30808 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8e6de0d4604989bd997f7b70950166" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34797 } }
I20260808 07:11:19.798053 30808 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:19.798116 30808 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b8e6de0d4604989bd997f7b70950166, State: Initialized, Role: FOLLOWER
I20260808 07:11:19.798307 30808 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8e6de0d4604989bd997f7b70950166" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34797 } }
I20260808 07:11:19.798429 30808 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:19.798492 30808 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:19.798547 30808 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:19.799242 30808 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8e6de0d4604989bd997f7b70950166" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34797 } }
I20260808 07:11:19.799379 30808 leader_election.cc:302] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b8e6de0d4604989bd997f7b70950166; no voters:
I20260808 07:11:19.799574 30808 leader_election.cc:288] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:19.799597 30814 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:19.799724 30814 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [term 1 LEADER]: Becoming Leader. State: Replica: 8b8e6de0d4604989bd997f7b70950166, State: Running, Role: LEADER
I20260808 07:11:19.799880 30808 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:19.799877 30814 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8e6de0d4604989bd997f7b70950166" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34797 } }
I20260808 07:11:19.800482 30816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b8e6de0d4604989bd997f7b70950166. Latest consensus state: current_term: 1 leader_uuid: "8b8e6de0d4604989bd997f7b70950166" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8e6de0d4604989bd997f7b70950166" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34797 } } }
I20260808 07:11:19.800628 30816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:19.801120 30815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b8e6de0d4604989bd997f7b70950166" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8e6de0d4604989bd997f7b70950166" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34797 } } }
I20260808 07:11:19.801218 30815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166 [sys.catalog]: This master's current role is: LEADER
W20260808 07:11:19.802003 30830 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:11:19.802156 30830 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:11:19.802279 30824 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:19.802489 30824 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:19.804203 30824 catalog_manager.cc:1347] Generated new cluster ID: f21d38c31ec749369ba9ab58ab56fc21
I20260808 07:11:19.804279 30824 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:11:19 dist-test-slave-77v9 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 07:11:19.811645 30813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:19.798528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46707 (local address 127.0.0.1:34797)
0808 07:11:19.798846 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:19.798857 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:19.798889 (+ 32us) server_negotiation.cc:407] Connection header received
0808 07:11:19.799240 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:19.799246 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:19.799294 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:19.799451 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:19.800457 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:19.802544 (+ 2087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:19.803791 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:19.804469 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:19.804617 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:19.807404 (+ 2787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:19.807413 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:19.807413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:19.807426 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:19.809800 (+ 2374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:19.810279 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:19.810287 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:19.810288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:19.810404 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:19.810653 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:19.810655 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:19.810655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:19.810941 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:19.811168 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:19.811258 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 07:11:19.811422 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":104,"threads_started":1}
I20260808 07:11:19.813144 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:19.815125 30824 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:19.815976 30824 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:19.820039 30824 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b8e6de0d4604989bd997f7b70950166: Generated new TSK 0
I20260808 07:11:19.820340 30824 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:19.823863 30813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:19.815126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39023 (local address 127.0.0.1:34797)
0808 07:11:19.815181 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:19.815183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:19.815355 (+ 172us) server_negotiation.cc:407] Connection header received
0808 07:11:19.815453 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:19.815454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:19.815467 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:19.815537 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:19.816221 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:19.816919 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:19.817843 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:19.818106 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:19.818221 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:19.819921 (+ 1700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:19.819923 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:19.819923 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:19.819933 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:19.821957 (+ 2024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:19.822451 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:19.822453 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:19.822453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:19.822534 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:19.823096 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:19.823098 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:19.823098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:19.823323 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:19.823479 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:19.823640 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 07:11:19.823735 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:11:19.826894 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 30736
W20260808 07:11:19.834087 30719 connection.cc:535] client connection to 127.0.0.1:34797 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34797): Connection reset by peer (error 104)
2026-08-08T07:11:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1519 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:19 dist-test-slave-77v9 krb5kdc[30841](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:19 dist-test-slave-77v9 krb5kdc[30841](info): set up 2 sockets
Aug 08 07:11:19 dist-test-slave-77v9 krb5kdc[30841](info): commencing operation
krb5kdc: starting...
W20260808 07:11:20.985625 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:21 dist-test-slave-77v9 krb5kdc[30841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:11:21.137979 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42097
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42097
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:21.229991 30856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:21.230283 30856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:21.230324 30856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:21.232005 30856 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:21.232100 30856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:21.232126 30856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:21.232154 30856 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:21.232184 30856 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:21.233763 30856 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42097
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:21.234138 30856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:21.234393 30856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:21.240123 30865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:21.240161 30862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:21.240336 30861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:21.240595 30856 server_base.cc:1034] running on GCE node
I20260808 07:11:21.240936 30856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:21.241256 30856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:21.242458 30856 hybrid_clock.cc:648] HybridClock initialized: now 1786173081242423 us; error 51 us; skew 500 ppm
Aug 08 07:11:21 dist-test-slave-77v9 krb5kdc[30841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173081, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:21.245651 30856 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:11:21.246168 30856 webserver.cc:460] Webserver started at http://127.0.0.1:34057/ using document root <none> and password file <none>
I20260808 07:11:21.246454 30856 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:21.246533 30856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:21.246708 30856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:21.248042 30856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "c4c07277e9b84a97acc3da3174a9185c"
format_stamp: "Formatted at 2026-08-08 07:11:21 on dist-test-slave-77v9"
server_key: "cc61e4c08905b5ce22dd5f76d364e73d"
server_key_iv: "39df0065feacf6c514fbb08686415232"
server_key_version: "encryptionkey@0"
I20260808 07:11:21.248476 30856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "c4c07277e9b84a97acc3da3174a9185c"
format_stamp: "Formatted at 2026-08-08 07:11:21 on dist-test-slave-77v9"
server_key: "cc61e4c08905b5ce22dd5f76d364e73d"
server_key_iv: "39df0065feacf6c514fbb08686415232"
server_key_version: "encryptionkey@0"
I20260808 07:11:21.250198 30856 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260808 07:11:21.251209 30872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:21.251482 30856 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:21.251598 30856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "c4c07277e9b84a97acc3da3174a9185c"
format_stamp: "Formatted at 2026-08-08 07:11:21 on dist-test-slave-77v9"
server_key: "cc61e4c08905b5ce22dd5f76d364e73d"
server_key_iv: "39df0065feacf6c514fbb08686415232"
server_key_version: "encryptionkey@0"
I20260808 07:11:21.251701 30856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:21.265002 30856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:21.267462 30856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:21.267647 30856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:21.271799 30856 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42097
I20260808 07:11:21.271950 30930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42097 every 8 connection(s)
I20260808 07:11:21.272249 30856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:21.273433 30931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:21.274729 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 30856
I20260808 07:11:21.274948 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:21.275172 9592 external_mini_cluster.cc:1428] Setting key e64bceeaa32f9fe408f7755cf94ecd17
I20260808 07:11:21.276213 30931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c: Bootstrap starting.
I20260808 07:11:21.276855 30931 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:21.277151 30931 log.cc:824] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:21.277879 30931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c: No bootstrap required, opened a new log
I20260808 07:11:21.279644 30931 raft_consensus.cc:348] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4c07277e9b84a97acc3da3174a9185c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42097 } }
I20260808 07:11:21.279803 30931 raft_consensus.cc:374] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:21.279866 30931 raft_consensus.cc:729] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4c07277e9b84a97acc3da3174a9185c, State: Initialized, Role: FOLLOWER
I20260808 07:11:21.280032 30931 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4c07277e9b84a97acc3da3174a9185c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42097 } }
I20260808 07:11:21.280133 30931 raft_consensus.cc:388] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:21.280179 30931 raft_consensus.cc:482] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:21.280238 30931 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:21.280787 30931 raft_consensus.cc:504] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4c07277e9b84a97acc3da3174a9185c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42097 } }
I20260808 07:11:21.280936 30931 leader_election.cc:302] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c4c07277e9b84a97acc3da3174a9185c; no voters:
I20260808 07:11:21.281129 30931 leader_election.cc:288] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:21.281178 30936 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:21.281389 30936 raft_consensus.cc:686] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [term 1 LEADER]: Becoming Leader. State: Replica: c4c07277e9b84a97acc3da3174a9185c, State: Running, Role: LEADER
I20260808 07:11:21.281491 30931 sys_catalog.cc:564] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:21.281533 30936 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4c07277e9b84a97acc3da3174a9185c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42097 } }
I20260808 07:11:21.281744 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:21.275790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46169 (local address 127.0.0.1:42097)
0808 07:11:21.275993 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:21.276011 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:21.276037 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:11:21.276486 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:21.276492 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:21.276545 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:21.276693 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:21.276909 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:21.278318 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:21.279227 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:21.279668 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:21.279807 (+ 139us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:21.280726 (+ 919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:21.280730 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:21.280731 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:21.281024 (+ 293us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:21.281074 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:21.281090 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:21.281192 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:21.281406 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 07:11:21.281434 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":84,"threads_started":1}
I20260808 07:11:21.282166 30936 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c4c07277e9b84a97acc3da3174a9185c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4c07277e9b84a97acc3da3174a9185c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42097 } } }
I20260808 07:11:21.282267 30936 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:21.282423 30936 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4c07277e9b84a97acc3da3174a9185c. Latest consensus state: current_term: 1 leader_uuid: "c4c07277e9b84a97acc3da3174a9185c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4c07277e9b84a97acc3da3174a9185c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42097 } } }
I20260808 07:11:21.282498 30936 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:21.282814 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:21.283129 30944 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:21.283716 30944 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:21.285661 30944 catalog_manager.cc:1347] Generated new cluster ID: b8086c8048d944e0aef5c759c552a23f
I20260808 07:11:21.285732 30944 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:21.291826 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:21.284879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41541 (local address 127.0.0.1:42097)
0808 07:11:21.284927 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:21.284929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:21.285169 (+ 240us) server_negotiation.cc:407] Connection header received
0808 07:11:21.285240 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:21.285241 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:21.285254 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:21.285323 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:21.285547 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:21.289415 (+ 3868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:21.290258 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:21.290494 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:21.290572 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:21.291543 (+ 971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:21.291545 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:21.291545 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:21.291551 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:21.291566 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:21.291576 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:21.291634 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:21.291717 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 07:11:21.291728 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:11:21.312583 30944 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:21.313592 30944 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:21.323283 30944 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c4c07277e9b84a97acc3da3174a9185c: Generated new TSK 0
I20260808 07:11:21.323557 30944 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:21.330286 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 30856
W20260808 07:11:21.337062 30839 connection.cc:535] client connection to 127.0.0.1:42097 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42097): Connection reset by peer (error 104)
2026-08-08T07:11:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1503 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:21 dist-test-slave-77v9 krb5kdc[30963](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:21 dist-test-slave-77v9 krb5kdc[30963](info): set up 2 sockets
Aug 08 07:11:21 dist-test-slave-77v9 krb5kdc[30963](info): commencing operation
krb5kdc: starting...
W20260808 07:11:22.470347 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:22 dist-test-slave-77v9 krb5kdc[30963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:11:22.617458 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34163
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:22.708223 30977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:22.708452 30977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:22.708477 30977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:22.709720 30977 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:22.709769 30977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:22.709784 30977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:22.709796 30977 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:22.709817 30977 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:22.711361 30977 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34163
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:22.711628 30977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:22.711899 30977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:22.717677 30983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:22.717684 30982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:22.717684 30985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:22.717705 30977 server_base.cc:1034] running on GCE node
I20260808 07:11:22.718259 30977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:22.718564 30977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:22.719717 30977 hybrid_clock.cc:648] HybridClock initialized: now 1786173082719705 us; error 37 us; skew 500 ppm
Aug 08 07:11:22 dist-test-slave-77v9 krb5kdc[30963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173082, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:22.723417 30977 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:11:22.723994 30977 webserver.cc:460] Webserver started at http://127.0.0.1:33819/ using document root <none> and password file <none>
I20260808 07:11:22.724251 30977 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:22.724326 30977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:22.724500 30977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:22.725730 30977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "77a5ca79a2fe4893bdd40ce625d31bf5"
format_stamp: "Formatted at 2026-08-08 07:11:22 on dist-test-slave-77v9"
server_key: "d27386ed1a1cb0030cba73dd6c5240b1"
server_key_iv: "140fcdaa77401c507d13fd6c0a3829fa"
server_key_version: "encryptionkey@0"
I20260808 07:11:22.726130 30977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "77a5ca79a2fe4893bdd40ce625d31bf5"
format_stamp: "Formatted at 2026-08-08 07:11:22 on dist-test-slave-77v9"
server_key: "d27386ed1a1cb0030cba73dd6c5240b1"
server_key_iv: "140fcdaa77401c507d13fd6c0a3829fa"
server_key_version: "encryptionkey@0"
I20260808 07:11:22.727685 30977 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:11:22.728660 30993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:22.729032 30977 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:11:22.729229 30977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "77a5ca79a2fe4893bdd40ce625d31bf5"
format_stamp: "Formatted at 2026-08-08 07:11:22 on dist-test-slave-77v9"
server_key: "d27386ed1a1cb0030cba73dd6c5240b1"
server_key_iv: "140fcdaa77401c507d13fd6c0a3829fa"
server_key_version: "encryptionkey@0"
I20260808 07:11:22.729352 30977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:22.733569 30977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:22.736189 30977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:22.736420 30977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:22.741184 30977 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34163
I20260808 07:11:22.741241 31051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34163 every 8 connection(s)
I20260808 07:11:22.741648 30977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:22.742771 31052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:22.744006 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 30977
I20260808 07:11:22.744165 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:22.744396 9592 external_mini_cluster.cc:1428] Setting key f859acc730369a29269059f746786a9b
I20260808 07:11:22.745954 31052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5: Bootstrap starting.
I20260808 07:11:22.746784 31052 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:22.747205 31052 log.cc:824] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:22.748035 31055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:22.745291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34263 (local address 127.0.0.1:34163)
0808 07:11:22.745531 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:22.745540 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:22.745577 (+ 37us) server_negotiation.cc:407] Connection header received
0808 07:11:22.746236 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:22.746244 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:22.746275 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:22.746406 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:22.747265 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:22.747268 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:22.747269 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:22.747273 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:22.747308 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:22.747318 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:22.747539 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:22.747653 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 07:11:22.747697 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":131,"threads_started":1}
I20260808 07:11:22.748224 31052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5: No bootstrap required, opened a new log
I20260808 07:11:22.749325 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:22.751077 31052 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77a5ca79a2fe4893bdd40ce625d31bf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34163 } }
I20260808 07:11:22.751327 31052 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:22.751403 31052 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77a5ca79a2fe4893bdd40ce625d31bf5, State: Initialized, Role: FOLLOWER
I20260808 07:11:22.751559 31052 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77a5ca79a2fe4893bdd40ce625d31bf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34163 } }
I20260808 07:11:22.751690 31052 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:22.751763 31052 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:22.751828 31052 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:22.752605 31055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:22.751216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58941 (local address 127.0.0.1:34163)
0808 07:11:22.751287 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:22.751290 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:22.751565 (+ 275us) server_negotiation.cc:407] Connection header received
0808 07:11:22.751591 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:22.751591 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:22.751597 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:22.751661 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:22.752368 (+ 707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:22.752370 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:22.752371 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:22.752376 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:22.752394 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:22.752399 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:22.752470 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:22.752520 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 07:11:22.752535 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 07:11:22.752796 31052 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77a5ca79a2fe4893bdd40ce625d31bf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34163 } }
I20260808 07:11:22.752959 31052 leader_election.cc:302] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77a5ca79a2fe4893bdd40ce625d31bf5; no voters:
I20260808 07:11:22.753178 31052 leader_election.cc:288] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:22.753212 31062 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:22.753340 31062 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 77a5ca79a2fe4893bdd40ce625d31bf5, State: Running, Role: LEADER
I20260808 07:11:22.753433 31062 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77a5ca79a2fe4893bdd40ce625d31bf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34163 } }
I20260808 07:11:22.753479 31052 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:22.753854 31063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77a5ca79a2fe4893bdd40ce625d31bf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77a5ca79a2fe4893bdd40ce625d31bf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34163 } } }
I20260808 07:11:22.753865 31064 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77a5ca79a2fe4893bdd40ce625d31bf5. Latest consensus state: current_term: 1 leader_uuid: "77a5ca79a2fe4893bdd40ce625d31bf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77a5ca79a2fe4893bdd40ce625d31bf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34163 } } }
I20260808 07:11:22.753989 31064 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:22.753975 31063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:22.754356 31068 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:22.754946 31068 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:22.756680 31068 catalog_manager.cc:1347] Generated new cluster ID: 9ce310cd38414d9e89deb83c915442a6
I20260808 07:11:22.756742 31068 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:22.769438 31068 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:22.769663 31068 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:22.774398 31068 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77a5ca79a2fe4893bdd40ce625d31bf5: Generated new TSK 0
I20260808 07:11:22.774653 31068 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:22.782507 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 30977
2026-08-08T07:11:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1454 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:22 dist-test-slave-77v9 krb5kdc[31083](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:22 dist-test-slave-77v9 krb5kdc[31083](info): set up 2 sockets
Aug 08 07:11:22 dist-test-slave-77v9 krb5kdc[31083](info): commencing operation
krb5kdc: starting...
W20260808 07:11:23.961294 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.155s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:24 dist-test-slave-77v9 krb5kdc[31083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:11:24.112808 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34133
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34133
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:24.199506 31097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:24.199785 31097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:24.199829 31097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:24.201148 31097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:24.201217 31097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:24.201242 31097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:24.201279 31097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:24.201325 31097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:24.202865 31097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34133
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:24.203152 31097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:24.203398 31097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:11:24.209192 31097 server_base.cc:1034] running on GCE node
W20260808 07:11:24.209162 31103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:24.209198 31106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:24.209162 31104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:24.209730 31097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:24.210023 31097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:24.211191 31097 hybrid_clock.cc:648] HybridClock initialized: now 1786173084211177 us; error 31 us; skew 500 ppm
Aug 08 07:11:24 dist-test-slave-77v9 krb5kdc[31083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173084, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:24.220341 31097 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:11:24.221004 31097 webserver.cc:460] Webserver started at http://127.0.0.1:45025/ using document root <none> and password file <none>
I20260808 07:11:24.221314 31097 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:24.221395 31097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:24.221565 31097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:24.222899 31097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "dda5046da41e408bbfc60b103e4fc952"
format_stamp: "Formatted at 2026-08-08 07:11:24 on dist-test-slave-77v9"
server_key: "f5e2a0d5d15049e970eb58ef67613094"
server_key_iv: "2cc1fcd56329753b35b23b0ca8f6c596"
server_key_version: "encryptionkey@0"
I20260808 07:11:24.223304 31097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "dda5046da41e408bbfc60b103e4fc952"
format_stamp: "Formatted at 2026-08-08 07:11:24 on dist-test-slave-77v9"
server_key: "f5e2a0d5d15049e970eb58ef67613094"
server_key_iv: "2cc1fcd56329753b35b23b0ca8f6c596"
server_key_version: "encryptionkey@0"
I20260808 07:11:24.224792 31097 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:11:24.226174 31113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:24.226450 31097 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:11:24.226557 31097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "dda5046da41e408bbfc60b103e4fc952"
format_stamp: "Formatted at 2026-08-08 07:11:24 on dist-test-slave-77v9"
server_key: "f5e2a0d5d15049e970eb58ef67613094"
server_key_iv: "2cc1fcd56329753b35b23b0ca8f6c596"
server_key_version: "encryptionkey@0"
I20260808 07:11:24.226642 31097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:24.251582 31097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:24.254279 31097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:24.254472 31097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:24.259177 31097 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34133
I20260808 07:11:24.259260 31170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34133 every 8 connection(s)
I20260808 07:11:24.259665 31097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:24.260892 31171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:24.263263 31171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952: Bootstrap starting.
I20260808 07:11:24.263865 31171 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:24.264169 31171 log.cc:824] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:24.265035 31171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952: No bootstrap required, opened a new log
I20260808 07:11:24.266767 31171 raft_consensus.cc:348] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dda5046da41e408bbfc60b103e4fc952" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34133 } }
I20260808 07:11:24.266918 31171 raft_consensus.cc:374] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:24.266942 31171 raft_consensus.cc:729] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dda5046da41e408bbfc60b103e4fc952, State: Initialized, Role: FOLLOWER
I20260808 07:11:24.267088 31171 consensus_queue.cc:260] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dda5046da41e408bbfc60b103e4fc952" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34133 } }
I20260808 07:11:24.267161 31171 raft_consensus.cc:388] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:24.267182 31171 raft_consensus.cc:482] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:24.267230 31171 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:24.267781 31171 raft_consensus.cc:504] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dda5046da41e408bbfc60b103e4fc952" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34133 } }
I20260808 07:11:24.267869 31171 leader_election.cc:302] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dda5046da41e408bbfc60b103e4fc952; no voters:
I20260808 07:11:24.268045 31171 leader_election.cc:288] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:24.268180 31174 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:24.268370 31174 raft_consensus.cc:686] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [term 1 LEADER]: Becoming Leader. State: Replica: dda5046da41e408bbfc60b103e4fc952, State: Running, Role: LEADER
I20260808 07:11:24.268395 31171 sys_catalog.cc:564] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:24.268466 31174 consensus_queue.cc:237] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dda5046da41e408bbfc60b103e4fc952" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34133 } }
I20260808 07:11:24.269037 31175 sys_catalog.cc:455] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dda5046da41e408bbfc60b103e4fc952" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dda5046da41e408bbfc60b103e4fc952" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34133 } } }
I20260808 07:11:24.269269 31175 sys_catalog.cc:458] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:24.269189 31176 sys_catalog.cc:455] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dda5046da41e408bbfc60b103e4fc952. Latest consensus state: current_term: 1 leader_uuid: "dda5046da41e408bbfc60b103e4fc952" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dda5046da41e408bbfc60b103e4fc952" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34133 } } }
I20260808 07:11:24.269487 31176 sys_catalog.cc:458] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:24.269634 31187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:24.269831 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 31097
I20260808 07:11:24.269953 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:24.270161 9592 external_mini_cluster.cc:1428] Setting key dfc88afffb7a63c35ac172c54d4b1abe
I20260808 07:11:24.270184 31187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:24.272202 31187 catalog_manager.cc:1347] Generated new cluster ID: 6b271af9dd6e450a9f543e7b19f48862
I20260808 07:11:24.272270 31187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:11:24 dist-test-slave-77v9 krb5kdc[31083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 07:11:24.278712 31187 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:24.279343 31187 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:24.284780 31199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:24.270830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56229 (local address 127.0.0.1:34133)
0808 07:11:24.270994 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:24.271003 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:24.271036 (+ 33us) server_negotiation.cc:407] Connection header received
0808 07:11:24.271151 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:24.271158 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:24.271215 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:24.271356 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:24.272193 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:24.273648 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:24.274785 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:24.275434 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:24.275882 (+ 448us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:24.278753 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:24.278757 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:24.278757 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:24.278770 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:24.282666 (+ 3896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:24.283156 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:24.283159 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:24.283159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:24.283282 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:24.283508 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:24.283509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:24.283509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:24.283809 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:24.284116 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:24.284199 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 07:11:24.284505 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":78,"threads_started":1}
I20260808 07:11:24.285962 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:24.286401 31187 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dda5046da41e408bbfc60b103e4fc952: Generated new TSK 0
I20260808 07:11:24.286597 31187 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:24.296388 31199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:24.287678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32871 (local address 127.0.0.1:34133)
0808 07:11:24.287736 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:24.287738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:24.287904 (+ 166us) server_negotiation.cc:407] Connection header received
0808 07:11:24.287932 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:24.287933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:24.287944 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:24.288007 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:24.288693 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:24.289444 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:24.290525 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:24.290740 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:24.290805 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:24.292607 (+ 1802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:24.292609 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:24.292609 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:24.292617 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:24.294463 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:24.295048 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:24.295050 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:24.295050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:24.295116 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:24.295492 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:24.295495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:24.295495 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:24.295711 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:24.295857 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:24.296069 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 07:11:24.296176 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:11:24.299028 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 31097
2026-08-08T07:11:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1514 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:24 dist-test-slave-77v9 krb5kdc[31209](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:24 dist-test-slave-77v9 krb5kdc[31209](info): set up 2 sockets
Aug 08 07:11:24 dist-test-slave-77v9 krb5kdc[31209](info): commencing operation
krb5kdc: starting...
W20260808 07:11:25.484589 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:25 dist-test-slave-77v9 krb5kdc[31209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:11:25.628753 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46201
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:25.714570 31225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:25.714829 31225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:25.714872 31225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:25.716039 31225 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:25.716118 31225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:25.716144 31225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:25.716177 31225 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:25.716208 31225 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:25.717944 31225 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:25.718235 31225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:25.718483 31225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:25.723910 31234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:25.723894 31230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:25.723894 31231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:25.724491 31225 server_base.cc:1034] running on GCE node
I20260808 07:11:25.724756 31225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:25.725111 31225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:25.726274 31225 hybrid_clock.cc:648] HybridClock initialized: now 1786173085726250 us; error 43 us; skew 500 ppm
Aug 08 07:11:25 dist-test-slave-77v9 krb5kdc[31209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173085, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:25.729152 31225 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:11:25.729709 31225 webserver.cc:460] Webserver started at http://127.0.0.1:36013/ using document root <none> and password file <none>
I20260808 07:11:25.729970 31225 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:25.730021 31225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:25.730203 31225 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:25.731460 31225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "09bf076166fe4a498d774e6b91e3709e"
format_stamp: "Formatted at 2026-08-08 07:11:25 on dist-test-slave-77v9"
server_key: "3d9a63995f8762eadb004cf846e3728b"
server_key_iv: "995deb7a4cbbc847f44918235e653eec"
server_key_version: "encryptionkey@0"
I20260808 07:11:25.731863 31225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "09bf076166fe4a498d774e6b91e3709e"
format_stamp: "Formatted at 2026-08-08 07:11:25 on dist-test-slave-77v9"
server_key: "3d9a63995f8762eadb004cf846e3728b"
server_key_iv: "995deb7a4cbbc847f44918235e653eec"
server_key_version: "encryptionkey@0"
I20260808 07:11:25.733587 31225 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260808 07:11:25.734449 31241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:25.734644 31225 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:25.734747 31225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "09bf076166fe4a498d774e6b91e3709e"
format_stamp: "Formatted at 2026-08-08 07:11:25 on dist-test-slave-77v9"
server_key: "3d9a63995f8762eadb004cf846e3728b"
server_key_iv: "995deb7a4cbbc847f44918235e653eec"
server_key_version: "encryptionkey@0"
I20260808 07:11:25.734808 31225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:25.747587 31225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:25.749773 31225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:25.749899 31225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:25.754559 31225 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46201
I20260808 07:11:25.754724 31298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46201 every 8 connection(s)
I20260808 07:11:25.755055 31225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:25.756349 31299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:25.758802 31299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e: Bootstrap starting.
I20260808 07:11:25.759409 31299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:25.759709 31299 log.cc:824] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:25.760506 31299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e: No bootstrap required, opened a new log
I20260808 07:11:25.762207 31299 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09bf076166fe4a498d774e6b91e3709e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46201 } }
I20260808 07:11:25.762351 31299 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:25.762373 31299 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09bf076166fe4a498d774e6b91e3709e, State: Initialized, Role: FOLLOWER
I20260808 07:11:25.762532 31299 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09bf076166fe4a498d774e6b91e3709e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46201 } }
I20260808 07:11:25.762596 31299 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:25.762616 31299 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:25.762678 31299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:25.763252 31299 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09bf076166fe4a498d774e6b91e3709e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46201 } }
I20260808 07:11:25.763348 31299 leader_election.cc:302] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09bf076166fe4a498d774e6b91e3709e; no voters:
I20260808 07:11:25.763535 31299 leader_election.cc:288] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:25.763670 31304 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:25.763864 31299 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:25.763868 31304 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [term 1 LEADER]: Becoming Leader. State: Replica: 09bf076166fe4a498d774e6b91e3709e, State: Running, Role: LEADER
I20260808 07:11:25.764084 31304 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09bf076166fe4a498d774e6b91e3709e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46201 } }
I20260808 07:11:25.765054 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 31225
I20260808 07:11:25.765059 31306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09bf076166fe4a498d774e6b91e3709e. Latest consensus state: current_term: 1 leader_uuid: "09bf076166fe4a498d774e6b91e3709e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09bf076166fe4a498d774e6b91e3709e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46201 } } }
I20260808 07:11:25.765167 31306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:25.765193 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:25.765415 9592 external_mini_cluster.cc:1428] Setting key 17b049b375ad48c0f12a66d26cc958a1
I20260808 07:11:25.765614 31305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09bf076166fe4a498d774e6b91e3709e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09bf076166fe4a498d774e6b91e3709e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46201 } } }
I20260808 07:11:25.765940 31305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e [sys.catalog]: This master's current role is: LEADER
W20260808 07:11:25.766393 31324 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:11:25.766463 31324 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:11:25.766557 31319 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:25.766728 31319 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:25.769265 31319 catalog_manager.cc:1347] Generated new cluster ID: 0efc561feeff4656beef9ac448b1f34c
I20260808 07:11:25.769343 31319 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:25.773437 31327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:25.766201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45115 (local address 127.0.0.1:46201)
0808 07:11:25.766501 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:25.766510 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:25.766552 (+ 42us) server_negotiation.cc:407] Connection header received
0808 07:11:25.766691 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:25.766700 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:25.766816 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:25.766961 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:25.767316 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:25.769275 (+ 1959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:25.770582 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:25.771291 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:25.771407 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:25.772359 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:25.772364 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:25.772364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:25.772602 (+ 238us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:25.772660 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:25.772676 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:25.772742 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:25.773105 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 07:11:25.773185 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":165,"threads_started":1}
I20260808 07:11:25.774402 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:25.782809 31319 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:25.783625 31319 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:25.786218 31327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:25.776474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44145 (local address 127.0.0.1:46201)
0808 07:11:25.776516 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:25.776518 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:25.782996 (+ 6478us) server_negotiation.cc:407] Connection header received
0808 07:11:25.783106 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:25.783107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:25.783120 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:25.783205 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:25.783391 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:25.784082 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:25.784876 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:25.785086 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:25.785167 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:25.785915 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:25.785916 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:25.785916 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:25.785923 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:25.785944 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:25.785948 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:25.786004 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:25.786070 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 07:11:25.786112 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:11:25.787878 31319 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09bf076166fe4a498d774e6b91e3709e: Generated new TSK 0
I20260808 07:11:25.788079 31319 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:25.792337 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 31225
2026-08-08T07:11:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1491 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:25 dist-test-slave-77v9 krb5kdc[31336](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:25 dist-test-slave-77v9 krb5kdc[31336](info): set up 2 sockets
Aug 08 07:11:25 dist-test-slave-77v9 krb5kdc[31336](info): commencing operation
krb5kdc: starting...
W20260808 07:11:26.928021 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:27 dist-test-slave-77v9 krb5kdc[31336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:11:27.077627 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42547
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42547
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:27.170985 31350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:27.171240 31350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:27.171269 31350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:27.172600 31350 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:27.172654 31350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:27.172670 31350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:27.172685 31350 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:27.172699 31350 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:27.174547 31350 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:27.174849 31350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:27.175109 31350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:27.180606 31356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:27.180629 31358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:27.180872 31355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:27.180888 31350 server_base.cc:1034] running on GCE node
I20260808 07:11:27.181151 31350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:27.181473 31350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:27.182665 31350 hybrid_clock.cc:648] HybridClock initialized: now 1786173087182607 us; error 75 us; skew 500 ppm
Aug 08 07:11:27 dist-test-slave-77v9 krb5kdc[31336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173087, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:27.185576 31350 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:11:27.186116 31350 webserver.cc:460] Webserver started at http://127.0.0.1:39633/ using document root <none> and password file <none>
I20260808 07:11:27.186367 31350 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:27.186448 31350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:27.186607 31350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:27.187724 31350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "3df5087fd3b64c68a3eafe5349341e7c"
format_stamp: "Formatted at 2026-08-08 07:11:27 on dist-test-slave-77v9"
server_key: "1ee81f8c212e53c72300a87e74b20ded"
server_key_iv: "9c1cfd04af71ba4ae083ff359022e857"
server_key_version: "encryptionkey@0"
I20260808 07:11:27.188103 31350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "3df5087fd3b64c68a3eafe5349341e7c"
format_stamp: "Formatted at 2026-08-08 07:11:27 on dist-test-slave-77v9"
server_key: "1ee81f8c212e53c72300a87e74b20ded"
server_key_iv: "9c1cfd04af71ba4ae083ff359022e857"
server_key_version: "encryptionkey@0"
I20260808 07:11:27.189845 31350 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260808 07:11:27.190837 31365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:27.191531 31350 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:11:27.191689 31350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "3df5087fd3b64c68a3eafe5349341e7c"
format_stamp: "Formatted at 2026-08-08 07:11:27 on dist-test-slave-77v9"
server_key: "1ee81f8c212e53c72300a87e74b20ded"
server_key_iv: "9c1cfd04af71ba4ae083ff359022e857"
server_key_version: "encryptionkey@0"
I20260808 07:11:27.191787 31350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:27.195834 31350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:27.198446 31350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:27.198725 31350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:27.203647 31350 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42547
I20260808 07:11:27.203680 31422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42547 every 8 connection(s)
I20260808 07:11:27.204095 31350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:27.205302 31423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:27.207777 31423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c: Bootstrap starting.
I20260808 07:11:27.208557 31423 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:27.208900 31423 log.cc:824] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:27.209709 31423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c: No bootstrap required, opened a new log
I20260808 07:11:27.211433 31423 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3df5087fd3b64c68a3eafe5349341e7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42547 } }
I20260808 07:11:27.211580 31423 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:27.211604 31423 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3df5087fd3b64c68a3eafe5349341e7c, State: Initialized, Role: FOLLOWER
I20260808 07:11:27.211774 31423 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3df5087fd3b64c68a3eafe5349341e7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42547 } }
I20260808 07:11:27.211840 31423 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:27.211861 31423 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:27.211927 31423 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:27.212574 31423 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3df5087fd3b64c68a3eafe5349341e7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42547 } }
I20260808 07:11:27.212671 31423 leader_election.cc:302] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3df5087fd3b64c68a3eafe5349341e7c; no voters:
I20260808 07:11:27.212976 31426 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:27.213197 31426 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [term 1 LEADER]: Becoming Leader. State: Replica: 3df5087fd3b64c68a3eafe5349341e7c, State: Running, Role: LEADER
I20260808 07:11:27.213052 31423 leader_election.cc:288] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:27.213318 31426 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3df5087fd3b64c68a3eafe5349341e7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42547 } }
I20260808 07:11:27.213577 31423 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:27.213671 31427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3df5087fd3b64c68a3eafe5349341e7c. Latest consensus state: current_term: 1 leader_uuid: "3df5087fd3b64c68a3eafe5349341e7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3df5087fd3b64c68a3eafe5349341e7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42547 } } }
I20260808 07:11:27.213761 31427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:27.213832 31428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3df5087fd3b64c68a3eafe5349341e7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3df5087fd3b64c68a3eafe5349341e7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42547 } } }
I20260808 07:11:27.214021 31428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:27.214036 31430 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:27.214110 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 31350
I20260808 07:11:27.214241 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:27.214475 9592 external_mini_cluster.cc:1428] Setting key 34c235a60b0479ed092a82545e9827c7
I20260808 07:11:27.214743 31430 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:27.216728 31430 catalog_manager.cc:1347] Generated new cluster ID: 1bdd825332e24819b1ba9a457c9daef0
I20260808 07:11:27.216799 31430 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:27.217219 31447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:27.215064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45715 (local address 127.0.0.1:42547)
0808 07:11:27.215279 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:27.215290 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:27.215519 (+ 229us) server_negotiation.cc:407] Connection header received
0808 07:11:27.215640 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:27.215646 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:27.215698 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:27.215850 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:27.216634 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:27.216638 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:27.216638 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:27.216643 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:27.216685 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:27.216700 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:27.216754 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:27.216979 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 07:11:27.217031 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":73,"threads_started":1}
I20260808 07:11:27.218189 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:27.221376 31447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:27.219871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55697 (local address 127.0.0.1:42547)
0808 07:11:27.219911 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:27.219913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:27.220224 (+ 311us) server_negotiation.cc:407] Connection header received
0808 07:11:27.220317 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:27.220318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:27.220323 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:27.220351 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:27.221133 (+ 782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:27.221134 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:27.221135 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:27.221139 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:27.221155 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:27.221160 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:27.221191 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:27.221295 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 07:11:27.221308 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:11:27.228535 31430 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:27.228771 31430 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:27.234982 31430 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3df5087fd3b64c68a3eafe5349341e7c: Generated new TSK 0
I20260808 07:11:27.235234 31430 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:27.241513 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 31350
2026-08-08T07:11:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1448 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:27 dist-test-slave-77v9 krb5kdc[31457](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:27 dist-test-slave-77v9 krb5kdc[31457](info): set up 2 sockets
Aug 08 07:11:27 dist-test-slave-77v9 krb5kdc[31457](info): commencing operation
krb5kdc: starting...
W20260808 07:11:28.378806 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:28 dist-test-slave-77v9 krb5kdc[31457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:11:28.521373 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42237
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:28.611774 31471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:28.612010 31471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:28.612035 31471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:28.613211 31471 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:28.613260 31471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:28.613276 31471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:28.613291 31471 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:28.613303 31471 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:28.614799 31471 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:28.615012 31471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:28.615196 31471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:28.620335 31477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:28.620340 31479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:28.620666 31471 server_base.cc:1034] running on GCE node
W20260808 07:11:28.620698 31476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:28.621027 31471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:28.621361 31471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:28.622555 31471 hybrid_clock.cc:648] HybridClock initialized: now 1786173088622502 us; error 75 us; skew 500 ppm
Aug 08 07:11:28 dist-test-slave-77v9 krb5kdc[31457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173088, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:28.625511 31471 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:11:28.626094 31471 webserver.cc:460] Webserver started at http://127.0.0.1:44261/ using document root <none> and password file <none>
I20260808 07:11:28.626353 31471 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:28.626426 31471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:28.626598 31471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:28.627719 31471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "af403b9becbc45f880e793128fafbfe5"
format_stamp: "Formatted at 2026-08-08 07:11:28 on dist-test-slave-77v9"
server_key: "1c7c8ebe44cc415dc2217f4f11870712"
server_key_iv: "68484fd2e0cf190d9b15c5303cdaeb2d"
server_key_version: "encryptionkey@0"
I20260808 07:11:28.628103 31471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "af403b9becbc45f880e793128fafbfe5"
format_stamp: "Formatted at 2026-08-08 07:11:28 on dist-test-slave-77v9"
server_key: "1c7c8ebe44cc415dc2217f4f11870712"
server_key_iv: "68484fd2e0cf190d9b15c5303cdaeb2d"
server_key_version: "encryptionkey@0"
I20260808 07:11:28.629830 31471 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:11:28.630656 31486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:28.630893 31471 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:28.631009 31471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "af403b9becbc45f880e793128fafbfe5"
format_stamp: "Formatted at 2026-08-08 07:11:28 on dist-test-slave-77v9"
server_key: "1c7c8ebe44cc415dc2217f4f11870712"
server_key_iv: "68484fd2e0cf190d9b15c5303cdaeb2d"
server_key_version: "encryptionkey@0"
I20260808 07:11:28.631088 31471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:28.647502 31471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:28.650895 31471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:28.651127 31471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:28.655500 31471 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42237
I20260808 07:11:28.655541 31542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42237 every 8 connection(s)
I20260808 07:11:28.655970 31471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:28.657409 31543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:28.658792 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 31471
I20260808 07:11:28.658946 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:28.659161 9592 external_mini_cluster.cc:1428] Setting key 3656a4946ee66b77e80b55653bad2d38
I20260808 07:11:28.661808 31543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5: Bootstrap starting.
I20260808 07:11:28.662456 31543 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:28.662751 31543 log.cc:824] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:28.663573 31543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5: No bootstrap required, opened a new log
I20260808 07:11:28.666157 31543 raft_consensus.cc:348] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af403b9becbc45f880e793128fafbfe5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42237 } }
I20260808 07:11:28.666349 31543 raft_consensus.cc:374] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:28.666386 31543 raft_consensus.cc:729] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af403b9becbc45f880e793128fafbfe5, State: Initialized, Role: FOLLOWER
I20260808 07:11:28.666582 31543 consensus_queue.cc:260] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af403b9becbc45f880e793128fafbfe5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42237 } }
I20260808 07:11:28.666659 31543 raft_consensus.cc:388] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:28.666682 31543 raft_consensus.cc:482] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:28.666793 31543 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [term 0 FOLLOWER]: Advancing to term 1
Aug 08 07:11:28 dist-test-slave-77v9 krb5kdc[31457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 07:11:28.667480 31543 raft_consensus.cc:504] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af403b9becbc45f880e793128fafbfe5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42237 } }
I20260808 07:11:28.667596 31543 leader_election.cc:302] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af403b9becbc45f880e793128fafbfe5; no voters:
I20260808 07:11:28.667804 31543 leader_election.cc:288] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:28.667891 31548 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:28.668047 31548 raft_consensus.cc:686] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [term 1 LEADER]: Becoming Leader. State: Replica: af403b9becbc45f880e793128fafbfe5, State: Running, Role: LEADER
I20260808 07:11:28.668128 31543 sys_catalog.cc:564] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:28.668148 31548 consensus_queue.cc:237] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af403b9becbc45f880e793128fafbfe5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42237 } }
I20260808 07:11:28.668529 31548 sys_catalog.cc:455] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af403b9becbc45f880e793128fafbfe5. Latest consensus state: current_term: 1 leader_uuid: "af403b9becbc45f880e793128fafbfe5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af403b9becbc45f880e793128fafbfe5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42237 } } }
I20260808 07:11:28.668587 31549 sys_catalog.cc:455] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af403b9becbc45f880e793128fafbfe5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af403b9becbc45f880e793128fafbfe5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42237 } } }
I20260808 07:11:28.668675 31548 sys_catalog.cc:458] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:28.669452 31549 sys_catalog.cc:458] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:28.669790 31561 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:28.670356 31561 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:28.671649 31546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:28.659854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:43781 (local address 127.0.0.1:42237)
0808 07:11:28.660060 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:28.660069 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:28.660101 (+ 32us) server_negotiation.cc:407] Connection header received
0808 07:11:28.660572 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:28.660580 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:28.660634 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:28.660763 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:28.661651 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:28.662759 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:28.663859 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:28.664277 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:28.664380 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:28.667553 (+ 3173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:28.667558 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:28.667559 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:28.667572 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:28.669895 (+ 2323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:28.670383 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:28.670387 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:28.670387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:28.670499 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:28.670747 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:28.670749 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:28.670749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:28.671042 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:28.671199 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:28.671379 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 07:11:28.671489 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":105,"threads_started":1}
I20260808 07:11:28.672488 31561 catalog_manager.cc:1347] Generated new cluster ID: 5961e76fae9c4d38be7b486b5c55dead
I20260808 07:11:28.672561 31561 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:28.685364 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:28.695447 31546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:28.687089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:33311 (local address 127.0.0.1:42237)
0808 07:11:28.687133 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:28.687135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:28.687285 (+ 150us) server_negotiation.cc:407] Connection header received
0808 07:11:28.687352 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:28.687353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:28.687363 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:28.687463 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:28.688198 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:28.689355 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:28.690442 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:28.690754 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:28.690823 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:28.692433 (+ 1610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:28.692434 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:28.692434 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:28.692442 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:28.694122 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:28.694587 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:28.694588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:28.694589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:28.694649 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:28.694893 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:28.694894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:28.694894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:28.695021 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:28.695114 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:28.695280 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 07:11:28.695344 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:11:28.710402 31561 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:28.711022 31561 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:28.715152 31561 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af403b9becbc45f880e793128fafbfe5: Generated new TSK 0
I20260808 07:11:28.715394 31561 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:28.722486 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 31471
W20260808 07:11:28.729537 31454 connection.cc:535] client connection to 127.0.0.1:42237 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42237): Connection reset by peer (error 104)
2026-08-08T07:11:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1481 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:28 dist-test-slave-77v9 krb5kdc[31576](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:28 dist-test-slave-77v9 krb5kdc[31576](info): set up 2 sockets
Aug 08 07:11:28 dist-test-slave-77v9 krb5kdc[31576](info): commencing operation
krb5kdc: starting...
W20260808 07:11:29.896060 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:30 dist-test-slave-77v9 krb5kdc[31576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173090, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:11:30.054009 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37583
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:30.146834 31590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:30.147130 31590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:30.147178 31590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:30.148500 31590 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:30.148589 31590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:30.148624 31590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:30.148665 31590 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:30.148693 31590 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:30.150475 31590 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37583
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:30.150810 31590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:30.151093 31590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:30.157246 31596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:30.157358 31598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:30.157276 31595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:30.157531 31590 server_base.cc:1034] running on GCE node
I20260808 07:11:30.158128 31590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:30.158501 31590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:30.159722 31590 hybrid_clock.cc:648] HybridClock initialized: now 1786173090159692 us; error 49 us; skew 500 ppm
Aug 08 07:11:30 dist-test-slave-77v9 krb5kdc[31576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173090, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:30.167538 31590 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:11:30.168144 31590 webserver.cc:460] Webserver started at http://127.0.0.1:33367/ using document root <none> and password file <none>
I20260808 07:11:30.168424 31590 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:30.168506 31590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:30.168669 31590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:30.169968 31590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "6c443b0837294668bebc1f9ae03537f1"
format_stamp: "Formatted at 2026-08-08 07:11:30 on dist-test-slave-77v9"
server_key: "abba06924b26d295d95ca7ac22f7cc4e"
server_key_iv: "e9fe0e0b22d16f37a86d214336279181"
server_key_version: "encryptionkey@0"
I20260808 07:11:30.170377 31590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "6c443b0837294668bebc1f9ae03537f1"
format_stamp: "Formatted at 2026-08-08 07:11:30 on dist-test-slave-77v9"
server_key: "abba06924b26d295d95ca7ac22f7cc4e"
server_key_iv: "e9fe0e0b22d16f37a86d214336279181"
server_key_version: "encryptionkey@0"
I20260808 07:11:30.172370 31590 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:11:30.173995 31606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:30.174295 31590 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:30.174433 31590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "6c443b0837294668bebc1f9ae03537f1"
format_stamp: "Formatted at 2026-08-08 07:11:30 on dist-test-slave-77v9"
server_key: "abba06924b26d295d95ca7ac22f7cc4e"
server_key_iv: "e9fe0e0b22d16f37a86d214336279181"
server_key_version: "encryptionkey@0"
I20260808 07:11:30.174530 31590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:30.188567 31590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:30.191347 31590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:30.191561 31590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:30.196760 31590 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37583
I20260808 07:11:30.196784 31664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37583 every 8 connection(s)
I20260808 07:11:30.197345 31590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:30.198503 31665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:30.200922 31665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1: Bootstrap starting.
I20260808 07:11:30.201529 31665 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:30.201784 31665 log.cc:824] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:30.202307 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 31590
I20260808 07:11:30.202466 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:30.202658 31665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1: No bootstrap required, opened a new log
I20260808 07:11:30.202679 9592 external_mini_cluster.cc:1428] Setting key 81902cb8610cf8bff3768d8608dde664
I20260808 07:11:30.205876 31665 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c443b0837294668bebc1f9ae03537f1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37583 } }
I20260808 07:11:30.206071 31665 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:30.206103 31665 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c443b0837294668bebc1f9ae03537f1, State: Initialized, Role: FOLLOWER
I20260808 07:11:30.206228 31665 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c443b0837294668bebc1f9ae03537f1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37583 } }
I20260808 07:11:30.206324 31665 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:30.206362 31665 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:30.206418 31665 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:30.207069 31665 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c443b0837294668bebc1f9ae03537f1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37583 } }
I20260808 07:11:30.207165 31665 leader_election.cc:302] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c443b0837294668bebc1f9ae03537f1; no voters:
I20260808 07:11:30.207391 31665 leader_election.cc:288] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:30.207507 31670 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:30.207669 31670 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [term 1 LEADER]: Becoming Leader. State: Replica: 6c443b0837294668bebc1f9ae03537f1, State: Running, Role: LEADER
I20260808 07:11:30.207677 31665 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:30.207839 31670 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c443b0837294668bebc1f9ae03537f1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37583 } }
I20260808 07:11:30.208418 31673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c443b0837294668bebc1f9ae03537f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c443b0837294668bebc1f9ae03537f1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37583 } } }
I20260808 07:11:30.208500 31673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:30.209508 31681 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:30.209718 31672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c443b0837294668bebc1f9ae03537f1. Latest consensus state: current_term: 1 leader_uuid: "6c443b0837294668bebc1f9ae03537f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c443b0837294668bebc1f9ae03537f1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37583 } } }
I20260808 07:11:30.209862 31672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:30.209986 31669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:30.203324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:37047 (local address 127.0.0.1:37583)
0808 07:11:30.203569 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:30.203581 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:30.203618 (+ 37us) server_negotiation.cc:407] Connection header received
0808 07:11:30.204275 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:30.204285 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:30.204352 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:30.204513 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:30.204749 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:30.206217 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:30.207276 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:30.207925 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:30.208048 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:30.209014 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:30.209018 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:30.209018 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:30.209245 (+ 227us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:30.209293 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:30.209314 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:30.209396 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:30.209650 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 07:11:30.209683 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":115,"threads_started":1}
I20260808 07:11:30.210112 31681 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:30.211274 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:30.212248 31681 catalog_manager.cc:1347] Generated new cluster ID: c8c723bcda1b4d81a46442ea5997881a
I20260808 07:11:30.212296 31681 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:30.216578 31669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:30.212881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:36821 (local address 127.0.0.1:37583)
0808 07:11:30.212923 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:30.212925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:30.213106 (+ 181us) server_negotiation.cc:407] Connection header received
0808 07:11:30.213166 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:30.213167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:30.213177 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:30.213231 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:30.213378 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:30.214084 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:30.215159 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:30.215463 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:30.215526 (+ 63us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:30.216317 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:30.216318 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:30.216318 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:30.216323 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:30.216338 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:30.216343 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:30.216397 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:30.216485 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 07:11:30.216496 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:11:30.226521 31681 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:30.227139 31681 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:30.239966 31681 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c443b0837294668bebc1f9ae03537f1: Generated new TSK 0
I20260808 07:11:30.240207 31681 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:30.245733 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 31590
W20260808 07:11:30.252714 31573 connection.cc:535] client connection to 127.0.0.1:37583 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37583): Connection reset by peer (error 104)
2026-08-08T07:11:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1523 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:30 dist-test-slave-77v9 krb5kdc[31700](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:30 dist-test-slave-77v9 krb5kdc[31700](info): set up 2 sockets
Aug 08 07:11:30 dist-test-slave-77v9 krb5kdc[31700](info): commencing operation
krb5kdc: starting...
W20260808 07:11:31.407805 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:31 dist-test-slave-77v9 krb5kdc[31700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:11:31.554527 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34637
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34637
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:31.644728 31713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:31.645042 31713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:31.645071 31713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:31.646347 31713 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:31.646406 31713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:31.646423 31713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:31.646456 31713 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:31.646471 31713 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:31.648097 31713 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:31.648401 31713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:31.648675 31713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:31.654412 31719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:31.654422 31718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:31.654443 31721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:31.654964 31713 server_base.cc:1034] running on GCE node
I20260808 07:11:31.655241 31713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:31.655547 31713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:31.656723 31713 hybrid_clock.cc:648] HybridClock initialized: now 1786173091656706 us; error 35 us; skew 500 ppm
Aug 08 07:11:31 dist-test-slave-77v9 krb5kdc[31700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173091, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:31.659752 31713 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:11:31.660292 31713 webserver.cc:460] Webserver started at http://127.0.0.1:42375/ using document root <none> and password file <none>
I20260808 07:11:31.660641 31713 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:31.660698 31713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:31.660893 31713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:31.662349 31713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "124487e3e7dd4e3588c6187df0b8f4b2"
format_stamp: "Formatted at 2026-08-08 07:11:31 on dist-test-slave-77v9"
server_key: "25d5e07b033496b65195be34faafb0a4"
server_key_iv: "82064893487268567f08c30952174854"
server_key_version: "encryptionkey@0"
I20260808 07:11:31.662849 31713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "124487e3e7dd4e3588c6187df0b8f4b2"
format_stamp: "Formatted at 2026-08-08 07:11:31 on dist-test-slave-77v9"
server_key: "25d5e07b033496b65195be34faafb0a4"
server_key_iv: "82064893487268567f08c30952174854"
server_key_version: "encryptionkey@0"
I20260808 07:11:31.664464 31713 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:11:31.665488 31728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:31.665707 31713 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:11:31.665899 31713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "124487e3e7dd4e3588c6187df0b8f4b2"
format_stamp: "Formatted at 2026-08-08 07:11:31 on dist-test-slave-77v9"
server_key: "25d5e07b033496b65195be34faafb0a4"
server_key_iv: "82064893487268567f08c30952174854"
server_key_version: "encryptionkey@0"
I20260808 07:11:31.665992 31713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:31.670068 31713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:31.672788 31713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:31.673045 31713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:31.677827 31713 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34637
I20260808 07:11:31.677858 31784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34637 every 8 connection(s)
I20260808 07:11:31.678231 31713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:31.679246 31785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:31.681139 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 31713
I20260808 07:11:31.681336 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:31.681568 9592 external_mini_cluster.cc:1428] Setting key 0fffca51291ebc9c7bbf941ed0859a8e
I20260808 07:11:31.682384 31785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2: Bootstrap starting.
I20260808 07:11:31.683046 31785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:31.683368 31785 log.cc:824] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:31.684495 31785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2: No bootstrap required, opened a new log
I20260808 07:11:31.684600 31788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:31.682194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:38727 (local address 127.0.0.1:34637)
0808 07:11:31.682397 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:31.682408 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:31.682446 (+ 38us) server_negotiation.cc:407] Connection header received
0808 07:11:31.682984 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:31.682992 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:31.683019 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:31.683189 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:31.684002 (+ 813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:31.684005 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:31.684006 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:31.684010 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:31.684098 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:31.684113 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:31.684231 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:31.684343 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 07:11:31.684393 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":102,"threads_started":1}
I20260808 07:11:31.685986 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:31.687131 31785 raft_consensus.cc:348] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "124487e3e7dd4e3588c6187df0b8f4b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34637 } }
I20260808 07:11:31.687376 31785 raft_consensus.cc:374] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:31.687439 31785 raft_consensus.cc:729] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 124487e3e7dd4e3588c6187df0b8f4b2, State: Initialized, Role: FOLLOWER
I20260808 07:11:31.687572 31785 consensus_queue.cc:260] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "124487e3e7dd4e3588c6187df0b8f4b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34637 } }
I20260808 07:11:31.687783 31785 raft_consensus.cc:388] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:31.687881 31785 raft_consensus.cc:482] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:31.687953 31785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:31.688961 31785 raft_consensus.cc:504] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "124487e3e7dd4e3588c6187df0b8f4b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34637 } }
I20260808 07:11:31.689109 31785 leader_election.cc:302] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 124487e3e7dd4e3588c6187df0b8f4b2; no voters:
I20260808 07:11:31.689343 31785 leader_election.cc:288] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:31.689391 31796 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:31.689486 31788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:31.687812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:59161 (local address 127.0.0.1:34637)
0808 07:11:31.687861 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:31.687864 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:31.688219 (+ 355us) server_negotiation.cc:407] Connection header received
0808 07:11:31.688246 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:31.688247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:31.688253 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:31.688319 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:31.689065 (+ 746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:31.689066 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:31.689067 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:31.689072 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:31.689088 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:31.689092 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:31.689161 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:31.689277 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 07:11:31.689291 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:11:31.689582 31796 raft_consensus.cc:686] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [term 1 LEADER]: Becoming Leader. State: Replica: 124487e3e7dd4e3588c6187df0b8f4b2, State: Running, Role: LEADER
I20260808 07:11:31.689692 31785 sys_catalog.cc:564] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:31.689889 31796 consensus_queue.cc:237] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "124487e3e7dd4e3588c6187df0b8f4b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34637 } }
I20260808 07:11:31.690212 31796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "124487e3e7dd4e3588c6187df0b8f4b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "124487e3e7dd4e3588c6187df0b8f4b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34637 } } }
I20260808 07:11:31.690361 31796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:31.690508 31796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 124487e3e7dd4e3588c6187df0b8f4b2. Latest consensus state: current_term: 1 leader_uuid: "124487e3e7dd4e3588c6187df0b8f4b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "124487e3e7dd4e3588c6187df0b8f4b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34637 } } }
I20260808 07:11:31.690596 31796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:31.691115 31804 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:31.691617 31804 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:31.693729 31804 catalog_manager.cc:1347] Generated new cluster ID: dcaee83cb51240339e5194b046eb943b
I20260808 07:11:31.693794 31804 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:31.703008 31804 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:31.703225 31804 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:31.706614 31804 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 124487e3e7dd4e3588c6187df0b8f4b2: Generated new TSK 0
I20260808 07:11:31.706808 31804 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:31.708717 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 31713
2026-08-08T07:11:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1461 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:31 dist-test-slave-77v9 krb5kdc[31817](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:31 dist-test-slave-77v9 krb5kdc[31817](info): set up 2 sockets
Aug 08 07:11:31 dist-test-slave-77v9 krb5kdc[31817](info): commencing operation
krb5kdc: starting...
W20260808 07:11:32.826244 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.008s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:32 dist-test-slave-77v9 krb5kdc[31817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:11:32.968554 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38541
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38541
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:33.057550 31833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:33.057823 31833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:33.057862 31833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:33.059089 31833 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:33.059172 31833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:33.059198 31833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:33.059239 31833 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:33.059265 31833 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:33.061055 31833 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38541
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:33.061368 31833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:33.061640 31833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:33.067373 31839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:33.067471 31840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:33.067425 31842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:33.067507 31833 server_base.cc:1034] running on GCE node
I20260808 07:11:33.067898 31833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:33.068254 31833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:33.069446 31833 hybrid_clock.cc:648] HybridClock initialized: now 1786173093069426 us; error 33 us; skew 500 ppm
Aug 08 07:11:33 dist-test-slave-77v9 krb5kdc[31817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173093, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:33.072182 31833 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:11:33.072611 31833 webserver.cc:460] Webserver started at http://127.0.0.1:42575/ using document root <none> and password file <none>
I20260808 07:11:33.072952 31833 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:33.073004 31833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:33.073145 31833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:33.074504 31833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "936159c19e294f069e4fc5f3dde24001"
format_stamp: "Formatted at 2026-08-08 07:11:33 on dist-test-slave-77v9"
server_key: "35dfd914fd9cc5da40c41db30a2d34e2"
server_key_iv: "233da2b1622d7b7328da35ee60e585a3"
server_key_version: "encryptionkey@0"
I20260808 07:11:33.074929 31833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "936159c19e294f069e4fc5f3dde24001"
format_stamp: "Formatted at 2026-08-08 07:11:33 on dist-test-slave-77v9"
server_key: "35dfd914fd9cc5da40c41db30a2d34e2"
server_key_iv: "233da2b1622d7b7328da35ee60e585a3"
server_key_version: "encryptionkey@0"
I20260808 07:11:33.076495 31833 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:11:33.077605 31849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:33.078053 31833 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:11:33.078155 31833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "936159c19e294f069e4fc5f3dde24001"
format_stamp: "Formatted at 2026-08-08 07:11:33 on dist-test-slave-77v9"
server_key: "35dfd914fd9cc5da40c41db30a2d34e2"
server_key_iv: "233da2b1622d7b7328da35ee60e585a3"
server_key_version: "encryptionkey@0"
I20260808 07:11:33.078271 31833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:33.097148 31833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:33.099628 31833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:33.099810 31833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:33.104653 31833 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38541
I20260808 07:11:33.104692 31903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38541 every 8 connection(s)
I20260808 07:11:33.105139 31833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:33.105392 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 31833
I20260808 07:11:33.105522 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:33.105732 9592 external_mini_cluster.cc:1428] Setting key 1ff5f33ed7b6eff06aee379920071ec8
I20260808 07:11:33.106633 31904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:33.109931 31904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001: Bootstrap starting.
I20260808 07:11:33.110670 31904 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:33.111052 31904 log.cc:824] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:33.111847 31904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001: No bootstrap required, opened a new log
Aug 08 07:11:33 dist-test-slave-77v9 krb5kdc[31817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 07:11:33.114297 31904 raft_consensus.cc:348] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "936159c19e294f069e4fc5f3dde24001" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38541 } }
I20260808 07:11:33.114477 31904 raft_consensus.cc:374] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:33.114534 31904 raft_consensus.cc:729] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936159c19e294f069e4fc5f3dde24001, State: Initialized, Role: FOLLOWER
I20260808 07:11:33.114682 31904 consensus_queue.cc:260] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "936159c19e294f069e4fc5f3dde24001" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38541 } }
I20260808 07:11:33.114782 31904 raft_consensus.cc:388] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:33.114815 31904 raft_consensus.cc:482] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:33.114863 31904 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:33.115638 31904 raft_consensus.cc:504] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "936159c19e294f069e4fc5f3dde24001" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38541 } }
I20260808 07:11:33.115749 31904 leader_election.cc:302] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 936159c19e294f069e4fc5f3dde24001; no voters:
I20260808 07:11:33.115933 31904 leader_election.cc:288] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:33.116011 31909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:33.116199 31909 raft_consensus.cc:686] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [term 1 LEADER]: Becoming Leader. State: Replica: 936159c19e294f069e4fc5f3dde24001, State: Running, Role: LEADER
I20260808 07:11:33.116222 31904 sys_catalog.cc:564] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:33.116386 31909 consensus_queue.cc:237] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "936159c19e294f069e4fc5f3dde24001" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38541 } }
I20260808 07:11:33.116803 31910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "936159c19e294f069e4fc5f3dde24001" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "936159c19e294f069e4fc5f3dde24001" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38541 } } }
I20260808 07:11:33.116827 31911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 936159c19e294f069e4fc5f3dde24001. Latest consensus state: current_term: 1 leader_uuid: "936159c19e294f069e4fc5f3dde24001" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "936159c19e294f069e4fc5f3dde24001" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38541 } } }
I20260808 07:11:33.117066 31910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:33.117077 31911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:33.117578 31918 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:33.118470 31918 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:33.118495 31907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:33.106327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:36221 (local address 127.0.0.1:38541)
0808 07:11:33.106531 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:33.106538 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:33.106565 (+ 27us) server_negotiation.cc:407] Connection header received
0808 07:11:33.107064 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:33.107070 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:33.107118 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:33.107236 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:33.108181 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:33.109208 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:33.110367 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:33.110824 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:33.110903 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:33.114006 (+ 3103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:33.114011 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:33.114011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:33.114023 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:33.116159 (+ 2136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:33.116649 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:33.116652 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:33.116653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:33.116767 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:33.117121 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:33.117122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:33.117122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:33.117476 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:33.117646 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:33.118228 (+ 582us) server_negotiation.cc:299] Negotiation successful
0808 07:11:33.118344 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":110,"threads_started":1}
I20260808 07:11:33.119820 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:33.120150 31918 catalog_manager.cc:1347] Generated new cluster ID: d908168b4ad7438fb360e92d092ffd5a
I20260808 07:11:33.120200 31918 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:33.127709 31918 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:33.128554 31918 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:33.130439 31907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:33.121433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:56257 (local address 127.0.0.1:38541)
0808 07:11:33.121466 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:33.121468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:33.121670 (+ 202us) server_negotiation.cc:407] Connection header received
0808 07:11:33.121696 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:33.121697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:33.121707 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:33.121758 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:33.122493 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:33.123517 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:33.124859 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:33.125206 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:33.125277 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:33.126923 (+ 1646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:33.126924 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:33.126925 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:33.126934 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:33.129032 (+ 2098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:33.129471 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:33.129472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:33.129473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:33.129541 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:33.129795 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:33.129796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:33.129797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:33.129921 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:33.130047 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:33.130240 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 07:11:33.130316 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:11:33.132472 31918 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 936159c19e294f069e4fc5f3dde24001: Generated new TSK 0
I20260808 07:11:33.132671 31918 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:33.135371 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 31833
W20260808 07:11:33.141566 31815 connection.cc:535] client connection to 127.0.0.1:38541 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38541): Connection reset by peer (error 104)
2026-08-08T07:11:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1426 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:33 dist-test-slave-77v9 krb5kdc[31937](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:33 dist-test-slave-77v9 krb5kdc[31937](info): set up 2 sockets
Aug 08 07:11:33 dist-test-slave-77v9 krb5kdc[31937](info): commencing operation
krb5kdc: starting...
W20260808 07:11:34.250540 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:34 dist-test-slave-77v9 krb5kdc[31937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173094, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:11:34.400584 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38617
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38617
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:34.494000 31951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:34.494297 31951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:34.494345 31951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:34.495707 31951 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:34.495788 31951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:34.495816 31951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:34.495841 31951 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:34.495877 31951 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:34.497781 31951 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38617
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31951
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:34.498143 31951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:34.498400 31951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:34.504033 31957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:34.504033 31959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:34.504086 31956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:34.504395 31951 server_base.cc:1034] running on GCE node
I20260808 07:11:34.504704 31951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:34.505070 31951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:34.506233 31951 hybrid_clock.cc:648] HybridClock initialized: now 1786173094506191 us; error 57 us; skew 500 ppm
Aug 08 07:11:34 dist-test-slave-77v9 krb5kdc[31937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173094, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:34.509238 31951 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:11:34.509771 31951 webserver.cc:460] Webserver started at http://127.0.0.1:39689/ using document root <none> and password file <none>
I20260808 07:11:34.510022 31951 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:34.510074 31951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:34.510211 31951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:34.511324 31951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "b439f00876df4b02ac89f38e642e1e19"
format_stamp: "Formatted at 2026-08-08 07:11:34 on dist-test-slave-77v9"
server_key: "fa8f7df21b1b6398bfb931694a7e917b"
server_key_iv: "37afff8312388eabe7310e8aacee5699"
server_key_version: "encryptionkey@0"
I20260808 07:11:34.511708 31951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "b439f00876df4b02ac89f38e642e1e19"
format_stamp: "Formatted at 2026-08-08 07:11:34 on dist-test-slave-77v9"
server_key: "fa8f7df21b1b6398bfb931694a7e917b"
server_key_iv: "37afff8312388eabe7310e8aacee5699"
server_key_version: "encryptionkey@0"
I20260808 07:11:34.513513 31951 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:11:34.514537 31967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:34.514717 31951 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:34.514820 31951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "b439f00876df4b02ac89f38e642e1e19"
format_stamp: "Formatted at 2026-08-08 07:11:34 on dist-test-slave-77v9"
server_key: "fa8f7df21b1b6398bfb931694a7e917b"
server_key_iv: "37afff8312388eabe7310e8aacee5699"
server_key_version: "encryptionkey@0"
I20260808 07:11:34.514895 31951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:34.539841 31951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:34.542410 31951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:34.542547 31951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:34.548139 31951 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38617
I20260808 07:11:34.548246 32024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38617 every 8 connection(s)
I20260808 07:11:34.548643 31951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:34.549783 32025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:34.552295 32025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19: Bootstrap starting.
I20260808 07:11:34.553020 32025 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:34.553424 32025 log.cc:824] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:34.554313 32025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19: No bootstrap required, opened a new log
I20260808 07:11:34.556888 32025 raft_consensus.cc:348] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b439f00876df4b02ac89f38e642e1e19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38617 } }
I20260808 07:11:34.557075 32025 raft_consensus.cc:374] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:34.557103 32025 raft_consensus.cc:729] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b439f00876df4b02ac89f38e642e1e19, State: Initialized, Role: FOLLOWER
I20260808 07:11:34.557253 32025 consensus_queue.cc:260] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b439f00876df4b02ac89f38e642e1e19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38617 } }
I20260808 07:11:34.557344 32025 raft_consensus.cc:388] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:34.557371 32025 raft_consensus.cc:482] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:34.557404 32025 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:34.558146 32025 raft_consensus.cc:504] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b439f00876df4b02ac89f38e642e1e19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38617 } }
I20260808 07:11:34.558259 32025 leader_election.cc:302] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b439f00876df4b02ac89f38e642e1e19; no voters:
I20260808 07:11:34.558449 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 31951
I20260808 07:11:34.558543 32025 leader_election.cc:288] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:34.558566 32028 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:34.558588 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:34.558693 32028 raft_consensus.cc:686] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [term 1 LEADER]: Becoming Leader. State: Replica: b439f00876df4b02ac89f38e642e1e19, State: Running, Role: LEADER
I20260808 07:11:34.558785 32028 consensus_queue.cc:237] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b439f00876df4b02ac89f38e642e1e19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38617 } }
I20260808 07:11:34.558851 32025 sys_catalog.cc:564] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:34.559048 9592 external_mini_cluster.cc:1428] Setting key d0a557d8313149b295931b436054bb51
I20260808 07:11:34.559129 32028 sys_catalog.cc:455] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b439f00876df4b02ac89f38e642e1e19. Latest consensus state: current_term: 1 leader_uuid: "b439f00876df4b02ac89f38e642e1e19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b439f00876df4b02ac89f38e642e1e19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38617 } } }
I20260808 07:11:34.559199 32028 sys_catalog.cc:458] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:34.559401 32030 sys_catalog.cc:455] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b439f00876df4b02ac89f38e642e1e19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b439f00876df4b02ac89f38e642e1e19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38617 } } }
I20260808 07:11:34.559666 32030 sys_catalog.cc:458] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19 [sys.catalog]: This master's current role is: LEADER
W20260808 07:11:34.561160 32047 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:11:34.561236 32047 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:11:34.561403 32032 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:34.561620 32032 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:34.563829 32032 catalog_manager.cc:1347] Generated new cluster ID: 72325d1f68d848f099ca8b64c9c41173
I20260808 07:11:34.563886 32032 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:34.565626 32042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:34.559921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:41311 (local address 127.0.0.1:38617)
0808 07:11:34.560308 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:34.560320 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:34.560360 (+ 40us) server_negotiation.cc:407] Connection header received
0808 07:11:34.560495 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:34.560502 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:34.560572 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:34.560789 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:34.561029 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:34.562446 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:34.563315 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:34.563964 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:34.564082 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:34.564916 (+ 834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:34.564920 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:34.564920 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:34.565138 (+ 218us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:34.565177 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:34.565192 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:34.565282 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:34.565368 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 07:11:34.565397 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":115,"threads_started":1}
I20260808 07:11:34.566613 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:34.572167 32042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:34.568549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:49787 (local address 127.0.0.1:38617)
0808 07:11:34.568592 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:34.568594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:34.568604 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:11:34.568661 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:34.568662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:34.568672 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:34.568741 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:34.568938 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:34.569666 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:34.570710 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:34.571023 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:34.571085 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:34.571883 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:34.571884 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:34.571884 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:34.571890 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:34.571907 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:34.571911 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:34.571970 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:34.572072 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 07:11:34.572084 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:11:34.587073 32032 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:34.587954 32032 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:34.591452 32032 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b439f00876df4b02ac89f38e642e1e19: Generated new TSK 0
I20260808 07:11:34.591859 32032 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:34.595402 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 31951
W20260808 07:11:34.604336 31935 connection.cc:535] client connection to 127.0.0.1:38617 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38617): Connection reset by peer (error 104)
2026-08-08T07:11:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1463 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:34 dist-test-slave-77v9 krb5kdc[32058](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:34 dist-test-slave-77v9 krb5kdc[32058](info): set up 2 sockets
Aug 08 07:11:34 dist-test-slave-77v9 krb5kdc[32058](info): commencing operation
krb5kdc: starting...
W20260808 07:11:35.730340 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:35 dist-test-slave-77v9 krb5kdc[32058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:11:35.873665 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39219
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:35.966698 32072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:35.966948 32072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:35.966974 32072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:35.968335 32072 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:35.968410 32072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:35.968427 32072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:35.968441 32072 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:35.968453 32072 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:35.970520 32072 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39219
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:35.970796 32072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:35.971004 32072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:35.976732 32079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:35.976709 32081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:35.976709 32078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:35.977293 32072 server_base.cc:1034] running on GCE node
I20260808 07:11:35.977576 32072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:35.977949 32072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:35.979148 32072 hybrid_clock.cc:648] HybridClock initialized: now 1786173095979118 us; error 54 us; skew 500 ppm
Aug 08 07:11:35 dist-test-slave-77v9 krb5kdc[32058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173095, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:35.986343 32072 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:11:35.987027 32072 webserver.cc:460] Webserver started at http://127.0.0.1:42063/ using document root <none> and password file <none>
I20260808 07:11:35.987334 32072 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:35.987421 32072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:35.987586 32072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:35.989053 32072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "993136f84fe24404a061688b8f6ed3b7"
format_stamp: "Formatted at 2026-08-08 07:11:35 on dist-test-slave-77v9"
server_key: "b2161a220b758cfdba18db1b87b1f7b5"
server_key_iv: "32a9ce6be637fe12a27775f7f7a302c5"
server_key_version: "encryptionkey@0"
I20260808 07:11:35.989470 32072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "993136f84fe24404a061688b8f6ed3b7"
format_stamp: "Formatted at 2026-08-08 07:11:35 on dist-test-slave-77v9"
server_key: "b2161a220b758cfdba18db1b87b1f7b5"
server_key_iv: "32a9ce6be637fe12a27775f7f7a302c5"
server_key_version: "encryptionkey@0"
I20260808 07:11:35.991235 32072 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:11:35.992213 32088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:35.992553 32072 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:35.992688 32072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "993136f84fe24404a061688b8f6ed3b7"
format_stamp: "Formatted at 2026-08-08 07:11:35 on dist-test-slave-77v9"
server_key: "b2161a220b758cfdba18db1b87b1f7b5"
server_key_iv: "32a9ce6be637fe12a27775f7f7a302c5"
server_key_version: "encryptionkey@0"
I20260808 07:11:35.992784 32072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:35.996620 32072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:35.999614 32072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:35.999876 32072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:36.005029 32072 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39219
I20260808 07:11:36.005124 32143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39219 every 8 connection(s)
I20260808 07:11:36.005499 32072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:36.006937 32144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:36.009547 32144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7: Bootstrap starting.
I20260808 07:11:36.010251 32144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:36.010409 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 32072
I20260808 07:11:36.010560 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:36.010684 32144 log.cc:824] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:36.010779 9592 external_mini_cluster.cc:1428] Setting key 983c3008215fa6d79032f131ad9bdd9f
I20260808 07:11:36.011785 32144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7: No bootstrap required, opened a new log
I20260808 07:11:36.013523 32148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:36.011442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:50729 (local address 127.0.0.1:39219)
0808 07:11:36.011630 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:36.011638 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:36.011691 (+ 53us) server_negotiation.cc:407] Connection header received
0808 07:11:36.012169 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:36.012176 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:36.012201 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:36.012314 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:36.013044 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:36.013047 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:36.013047 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:36.013051 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:36.013090 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:36.013100 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:36.013174 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:36.013253 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 07:11:36.013310 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":71,"threads_started":1}
I20260808 07:11:36.015141 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:36.015125 32144 raft_consensus.cc:348] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "993136f84fe24404a061688b8f6ed3b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39219 } }
I20260808 07:11:36.015368 32144 raft_consensus.cc:374] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:36.015407 32144 raft_consensus.cc:729] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 993136f84fe24404a061688b8f6ed3b7, State: Initialized, Role: FOLLOWER
I20260808 07:11:36.015537 32144 consensus_queue.cc:260] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "993136f84fe24404a061688b8f6ed3b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39219 } }
I20260808 07:11:36.015630 32144 raft_consensus.cc:388] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:36.015666 32144 raft_consensus.cc:482] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:36.015719 32144 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:36.016656 32144 raft_consensus.cc:504] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "993136f84fe24404a061688b8f6ed3b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39219 } }
I20260808 07:11:36.016791 32144 leader_election.cc:302] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 993136f84fe24404a061688b8f6ed3b7; no voters:
I20260808 07:11:36.017262 32144 leader_election.cc:288] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:36.017330 32153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:36.017554 32153 raft_consensus.cc:686] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [term 1 LEADER]: Becoming Leader. State: Replica: 993136f84fe24404a061688b8f6ed3b7, State: Running, Role: LEADER
I20260808 07:11:36.017875 32144 sys_catalog.cc:564] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:36.017921 32153 consensus_queue.cc:237] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "993136f84fe24404a061688b8f6ed3b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39219 } }
I20260808 07:11:36.019009 32156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "993136f84fe24404a061688b8f6ed3b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "993136f84fe24404a061688b8f6ed3b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39219 } } }
I20260808 07:11:36.019019 32155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 993136f84fe24404a061688b8f6ed3b7. Latest consensus state: current_term: 1 leader_uuid: "993136f84fe24404a061688b8f6ed3b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "993136f84fe24404a061688b8f6ed3b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39219 } } }
I20260808 07:11:36.019220 32156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:36.019317 32148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:36.017298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:46609 (local address 127.0.0.1:39219)
0808 07:11:36.017391 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:36.017394 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:36.017786 (+ 392us) server_negotiation.cc:407] Connection header received
0808 07:11:36.017936 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:36.017938 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:36.017947 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:36.018019 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:36.018924 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:36.018926 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:36.018926 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:36.018935 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:36.018959 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:36.018967 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:36.019007 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:36.019136 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 07:11:36.019155 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 07:11:36.019330 32155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:36.020519 32166 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:36.021211 32166 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:36.026206 32166 catalog_manager.cc:1347] Generated new cluster ID: 5505b38e3faf4590b9bda0cee8962e70
I20260808 07:11:36.026264 32166 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:36.041864 32166 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:36.042074 32166 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:36.053612 32166 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 993136f84fe24404a061688b8f6ed3b7: Generated new TSK 0
I20260808 07:11:36.053851 32166 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:36.063819 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 32072
2026-08-08T07:11:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1465 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:36 dist-test-slave-77v9 krb5kdc[32176](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:36 dist-test-slave-77v9 krb5kdc[32176](info): set up 2 sockets
Aug 08 07:11:36 dist-test-slave-77v9 krb5kdc[32176](info): commencing operation
krb5kdc: starting...
W20260808 07:11:37.218160 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:37 dist-test-slave-77v9 krb5kdc[32176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:11:37.356401 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:38159
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:33045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:38159
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:37.448416 32190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:37.448686 32190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:37.448941 32190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:37.450363 32190 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:37.450414 32190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:37.450430 32190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:37.450443 32190 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:37.450456 32190 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:37.452184 32190 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:33045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:38159
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:38159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:37.452454 32190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:37.452703 32190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:37.458371 32200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:37.458415 32197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:37.458415 32198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:37.458516 32190 server_base.cc:1034] running on GCE node
I20260808 07:11:37.458824 32190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:37.459167 32190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:37.460342 32190 hybrid_clock.cc:648] HybridClock initialized: now 1786173097460317 us; error 41 us; skew 500 ppm
Aug 08 07:11:37 dist-test-slave-77v9 krb5kdc[32176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173097, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:37.463410 32190 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:11:37.463905 32190 webserver.cc:460] Webserver started at http://127.9.94.62:46175/ using document root <none> and password file <none>
I20260808 07:11:37.464156 32190 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:37.464228 32190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:37.464392 32190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:37.465595 32190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "1bc307228f464ac4ad9e7ce0001fe458"
format_stamp: "Formatted at 2026-08-08 07:11:37 on dist-test-slave-77v9"
server_key: "5152c77503614d05d9cb0394b2838dd5"
server_key_iv: "71b038165592fa89cd9c0540271f41f7"
server_key_version: "encryptionkey@0"
I20260808 07:11:37.465987 32190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "1bc307228f464ac4ad9e7ce0001fe458"
format_stamp: "Formatted at 2026-08-08 07:11:37 on dist-test-slave-77v9"
server_key: "5152c77503614d05d9cb0394b2838dd5"
server_key_iv: "71b038165592fa89cd9c0540271f41f7"
server_key_version: "encryptionkey@0"
I20260808 07:11:37.467624 32190 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:11:37.468564 32210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:37.468925 32190 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:37.469049 32190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "1bc307228f464ac4ad9e7ce0001fe458"
format_stamp: "Formatted at 2026-08-08 07:11:37 on dist-test-slave-77v9"
server_key: "5152c77503614d05d9cb0394b2838dd5"
server_key_iv: "71b038165592fa89cd9c0540271f41f7"
server_key_version: "encryptionkey@0"
I20260808 07:11:37.469156 32190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:37.478950 32190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:37.481215 32190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:37.481395 32190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:37.485584 32190 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:38159
I20260808 07:11:37.485610 32266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:38159 every 8 connection(s)
I20260808 07:11:37.485993 32190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:37.487020 32267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:37.489425 32267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458: Bootstrap starting.
I20260808 07:11:37.490077 32267 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:37.490383 32267 log.cc:824] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:37.491287 32267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458: No bootstrap required, opened a new log
I20260808 07:11:37.492753 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 32190
I20260808 07:11:37.492964 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:37.493196 9592 external_mini_cluster.cc:1428] Setting key 7b78ed5f294b672ff3e129be98a9a7ff
I20260808 07:11:37.493436 32267 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bc307228f464ac4ad9e7ce0001fe458" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38159 } }
I20260808 07:11:37.493618 32267 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:37.493692 32267 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bc307228f464ac4ad9e7ce0001fe458, State: Initialized, Role: FOLLOWER
I20260808 07:11:37.493939 32267 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bc307228f464ac4ad9e7ce0001fe458" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38159 } }
I20260808 07:11:37.494055 32267 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:37.494086 32267 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:37.494166 32267 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:37.495555 32267 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bc307228f464ac4ad9e7ce0001fe458" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38159 } }
I20260808 07:11:37.495661 32267 leader_election.cc:302] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1bc307228f464ac4ad9e7ce0001fe458; no voters:
I20260808 07:11:37.495870 32267 leader_election.cc:288] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:37.495908 32272 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:37.496018 32272 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [term 1 LEADER]: Becoming Leader. State: Replica: 1bc307228f464ac4ad9e7ce0001fe458, State: Running, Role: LEADER
I20260808 07:11:37.496160 32267 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:37.496168 32272 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bc307228f464ac4ad9e7ce0001fe458" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38159 } }
I20260808 07:11:37.496567 32272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1bc307228f464ac4ad9e7ce0001fe458. Latest consensus state: current_term: 1 leader_uuid: "1bc307228f464ac4ad9e7ce0001fe458" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bc307228f464ac4ad9e7ce0001fe458" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38159 } } }
I20260808 07:11:37.496877 32272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:37.496749 32273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1bc307228f464ac4ad9e7ce0001fe458" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bc307228f464ac4ad9e7ce0001fe458" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38159 } } }
I20260808 07:11:37.497160 32273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:37.497387 32281 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:37.497992 32281 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:37.500069 32281 catalog_manager.cc:1347] Generated new cluster ID: a710812e0b644e48a71242c057e780e5
I20260808 07:11:37.500138 32281 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:11:37 dist-test-slave-77v9 krb5kdc[32176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:37.505414 32271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:37.493740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55443 (local address 127.9.94.62:38159)
0808 07:11:37.493957 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:37.493966 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:37.493992 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:11:37.494117 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:37.494124 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:37.494185 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:37.494322 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:37.495411 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:37.496697 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:37.497989 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:37.498603 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:37.498741 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:37.501706 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:37.501711 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:37.501711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:37.501723 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:37.503494 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:37.503924 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:37.503927 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:37.503927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:37.504024 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:37.504277 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:37.504278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:37.504278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:37.504534 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:37.504717 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:37.504895 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 07:11:37.505095 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":127,"threads_started":1}
I20260808 07:11:37.506549 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:37.514922 32271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:37.508025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46107 (local address 127.9.94.62:38159)
0808 07:11:37.508081 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:37.508083 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:37.508201 (+ 118us) server_negotiation.cc:407] Connection header received
0808 07:11:37.508279 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:37.508280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:37.508289 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:37.508339 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:37.508999 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:37.509519 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:37.510229 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:37.510468 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:37.510562 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:37.511938 (+ 1376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:37.511940 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:37.511940 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:37.511948 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:37.513478 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:37.513885 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:37.513887 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:37.513887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:37.513950 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:37.514183 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:37.514185 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:37.514185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:37.514419 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:37.514677 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:37.514747 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 07:11:37.514822 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 07:11:37.515071 32281 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:37.515914 32281 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:37.524778 32281 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1bc307228f464ac4ad9e7ce0001fe458: Generated new TSK 0
I20260808 07:11:37.525097 32281 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:37.528725 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 32190
W20260808 07:11:37.534473 32174 connection.cc:535] client connection to 127.9.94.62:38159 recv error: Network error: failed to read from TLS socket (remote: 127.9.94.62:38159): Connection reset by peer (error 104)
2026-08-08T07:11:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1463 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:37 dist-test-slave-77v9 krb5kdc[32300](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:37 dist-test-slave-77v9 krb5kdc[32300](info): set up 2 sockets
Aug 08 07:11:37 dist-test-slave-77v9 krb5kdc[32300](info): commencing operation
krb5kdc: starting...
W20260808 07:11:38.683570 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:38 dist-test-slave-77v9 krb5kdc[32300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:11:38.829046 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36865
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:40227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:36865
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:38.919673 32315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:38.919965 32315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:38.920006 32315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:38.921248 32315 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:38.921326 32315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:38.921351 32315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:38.921380 32315 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:38.921411 32315 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:38.923202 32315 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:40227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:36865
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:38.923563 32315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:38.923837 32315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:38.929286 32323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:38.929281 32320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:38.929283 32321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:38.929569 32315 server_base.cc:1034] running on GCE node
I20260808 07:11:38.929829 32315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:38.930229 32315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:38.931494 32315 hybrid_clock.cc:648] HybridClock initialized: now 1786173098931483 us; error 36 us; skew 500 ppm
Aug 08 07:11:38 dist-test-slave-77v9 krb5kdc[32300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173098, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:38.934743 32315 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:11:38.935302 32315 webserver.cc:460] Webserver started at http://127.9.94.62:38391/ using document root <none> and password file <none>
I20260808 07:11:38.935564 32315 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:38.935638 32315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:38.935794 32315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:38.937026 32315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "2ca822b1909343779cd1d8a017dc6791"
format_stamp: "Formatted at 2026-08-08 07:11:38 on dist-test-slave-77v9"
server_key: "9611ea1d9561e779e5204e8237622b7a"
server_key_iv: "ab5b35c8b46569561a18a0856e8fb921"
server_key_version: "encryptionkey@0"
I20260808 07:11:38.937407 32315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "2ca822b1909343779cd1d8a017dc6791"
format_stamp: "Formatted at 2026-08-08 07:11:38 on dist-test-slave-77v9"
server_key: "9611ea1d9561e779e5204e8237622b7a"
server_key_iv: "ab5b35c8b46569561a18a0856e8fb921"
server_key_version: "encryptionkey@0"
I20260808 07:11:38.938874 32315 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:11:38.939878 32330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:38.940233 32315 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:38.940393 32315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "2ca822b1909343779cd1d8a017dc6791"
format_stamp: "Formatted at 2026-08-08 07:11:38 on dist-test-slave-77v9"
server_key: "9611ea1d9561e779e5204e8237622b7a"
server_key_iv: "ab5b35c8b46569561a18a0856e8fb921"
server_key_version: "encryptionkey@0"
I20260808 07:11:38.940492 32315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:38.974781 32315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:38.977455 32315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:38.977648 32315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:38.982100 32315 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:36865
I20260808 07:11:38.982177 32387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:36865 every 8 connection(s)
I20260808 07:11:38.982565 32315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:38.983543 32388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:38.985929 32388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791: Bootstrap starting.
I20260808 07:11:38.986267 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 32315
I20260808 07:11:38.986416 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:38.986667 9592 external_mini_cluster.cc:1428] Setting key bc3bc037bf4bcd53cf0a64a81d480150
I20260808 07:11:38.986665 32388 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:38.987046 32388 log.cc:824] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:38.988086 32388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791: No bootstrap required, opened a new log
I20260808 07:11:38.990574 32388 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ca822b1909343779cd1d8a017dc6791" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36865 } }
I20260808 07:11:38.990720 32388 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:38.990744 32388 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca822b1909343779cd1d8a017dc6791, State: Initialized, Role: FOLLOWER
I20260808 07:11:38.990909 32388 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ca822b1909343779cd1d8a017dc6791" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36865 } }
I20260808 07:11:38.991009 32388 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:38.991055 32388 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:38.991109 32388 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:38.991710 32388 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ca822b1909343779cd1d8a017dc6791" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36865 } }
I20260808 07:11:38.991834 32388 leader_election.cc:302] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ca822b1909343779cd1d8a017dc6791; no voters:
I20260808 07:11:38.992158 32388 leader_election.cc:288] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:38.992264 32393 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:38.992457 32393 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca822b1909343779cd1d8a017dc6791, State: Running, Role: LEADER
I20260808 07:11:38.992513 32388 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:38.992641 32393 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ca822b1909343779cd1d8a017dc6791" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36865 } }
I20260808 07:11:38.993266 32393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ca822b1909343779cd1d8a017dc6791. Latest consensus state: current_term: 1 leader_uuid: "2ca822b1909343779cd1d8a017dc6791" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ca822b1909343779cd1d8a017dc6791" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36865 } } }
I20260808 07:11:38.993368 32393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:38.993300 32394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ca822b1909343779cd1d8a017dc6791" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ca822b1909343779cd1d8a017dc6791" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36865 } } }
I20260808 07:11:38.993490 32394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:38.994099 32391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:38.987244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50611 (local address 127.9.94.62:36865)
0808 07:11:38.987448 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:38.987458 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:38.987496 (+ 38us) server_negotiation.cc:407] Connection header received
0808 07:11:38.988089 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:38.988097 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:38.988158 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:38.988310 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:38.988543 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:38.989980 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:38.990869 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:38.991436 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:38.991584 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:38.992534 (+ 950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:38.992539 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:38.992539 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:38.992765 (+ 226us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:38.992830 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:38.992848 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:38.992933 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:38.993723 (+ 790us) server_negotiation.cc:299] Negotiation successful
0808 07:11:38.993756 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":100,"threads_started":1}
I20260808 07:11:38.994457 32401 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:38.994940 32401 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:38.995124 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:38.996554 32401 catalog_manager.cc:1347] Generated new cluster ID: c6787e35cf734cee983d4df285b94e7b
I20260808 07:11:38.996606 32401 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:39.006268 32391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:39.001204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50969 (local address 127.9.94.62:36865)
0808 07:11:39.001263 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:39.001266 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:39.001472 (+ 206us) server_negotiation.cc:407] Connection header received
0808 07:11:39.001539 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:39.001540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:39.001553 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:39.001614 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:39.001803 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:39.002934 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:39.004244 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:39.004914 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:39.005123 (+ 209us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:39.005986 (+ 863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:39.005988 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:39.005988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:39.005994 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:39.006010 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:39.006015 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:39.006078 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:39.006159 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 07:11:39.006173 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 07:11:39.012647 32401 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:39.013487 32401 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:39.019451 32401 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ca822b1909343779cd1d8a017dc6791: Generated new TSK 0
I20260808 07:11:39.019702 32401 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:39.024085 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 32315
W20260808 07:11:39.032099 32297 connection.cc:535] client connection to 127.9.94.62:36865 recv error: Network error: failed to read from TLS socket (remote: 127.9.94.62:36865): Connection reset by peer (error 104)
2026-08-08T07:11:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1498 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:39 dist-test-slave-77v9 krb5kdc[32420](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:39 dist-test-slave-77v9 krb5kdc[32420](info): set up 2 sockets
Aug 08 07:11:39 dist-test-slave-77v9 krb5kdc[32420](info): commencing operation
krb5kdc: starting...
W20260808 07:11:40.170666 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:40 dist-test-slave-77v9 krb5kdc[32420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:11:40.313516 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:34863
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:44297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:34863
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:40.400760 32437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:40.400993 32437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:40.401016 32437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:40.402153 32437 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:40.402194 32437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:40.402207 32437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:40.402221 32437 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:40.402233 32437 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:40.403718 32437 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:44297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:34863
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:34863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:40.403982 32437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:40.404220 32437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:40.409904 32443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:40.409915 32442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:40.409868 32445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:40.409981 32437 server_base.cc:1034] running on GCE node
I20260808 07:11:40.410396 32437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:40.410704 32437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:40.411931 32437 hybrid_clock.cc:648] HybridClock initialized: now 1786173100411910 us; error 47 us; skew 500 ppm
Aug 08 07:11:40 dist-test-slave-77v9 krb5kdc[32420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173100, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:40.414921 32437 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:11:40.415477 32437 webserver.cc:460] Webserver started at http://127.9.94.62:37959/ using document root <none> and password file <none>
I20260808 07:11:40.415732 32437 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:40.415809 32437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:40.415973 32437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:40.417249 32437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "3a73421852c24e5f907199d855133cc3"
format_stamp: "Formatted at 2026-08-08 07:11:40 on dist-test-slave-77v9"
server_key: "d937ca988bf37ba24a039af54c2b6cb6"
server_key_iv: "fe0df779e7ecdf4a13f0e2280ac75952"
server_key_version: "encryptionkey@0"
I20260808 07:11:40.417649 32437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "3a73421852c24e5f907199d855133cc3"
format_stamp: "Formatted at 2026-08-08 07:11:40 on dist-test-slave-77v9"
server_key: "d937ca988bf37ba24a039af54c2b6cb6"
server_key_iv: "fe0df779e7ecdf4a13f0e2280ac75952"
server_key_version: "encryptionkey@0"
I20260808 07:11:40.419194 32437 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:11:40.420162 32452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:40.420447 32437 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:40.420573 32437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "3a73421852c24e5f907199d855133cc3"
format_stamp: "Formatted at 2026-08-08 07:11:40 on dist-test-slave-77v9"
server_key: "d937ca988bf37ba24a039af54c2b6cb6"
server_key_iv: "fe0df779e7ecdf4a13f0e2280ac75952"
server_key_version: "encryptionkey@0"
I20260808 07:11:40.420660 32437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:40.424562 32437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:40.426962 32437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:40.427131 32437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:40.431651 32437 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:34863
I20260808 07:11:40.431682 32508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:34863 every 8 connection(s)
I20260808 07:11:40.432052 32437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:40.433203 32509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:40.435459 32509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3: Bootstrap starting.
I20260808 07:11:40.436024 32509 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:40.436273 32509 log.cc:824] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:40.437055 32509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3: No bootstrap required, opened a new log
I20260808 07:11:40.438619 32509 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a73421852c24e5f907199d855133cc3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34863 } }
I20260808 07:11:40.438756 32509 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:40.438779 32509 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a73421852c24e5f907199d855133cc3, State: Initialized, Role: FOLLOWER
I20260808 07:11:40.438887 32509 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a73421852c24e5f907199d855133cc3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34863 } }
I20260808 07:11:40.438967 32509 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:40.439005 32509 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:40.439055 32509 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:40.439885 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 32437
I20260808 07:11:40.440017 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:40.440079 32509 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a73421852c24e5f907199d855133cc3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34863 } }
I20260808 07:11:40.440196 32509 leader_election.cc:302] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a73421852c24e5f907199d855133cc3; no voters:
I20260808 07:11:40.440243 9592 external_mini_cluster.cc:1428] Setting key f31de0b2a1d951886029b0df6601469c
I20260808 07:11:40.440367 32509 leader_election.cc:288] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:40.440467 32512 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:40.440641 32509 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:40.440686 32512 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [term 1 LEADER]: Becoming Leader. State: Replica: 3a73421852c24e5f907199d855133cc3, State: Running, Role: LEADER
I20260808 07:11:40.440908 32512 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a73421852c24e5f907199d855133cc3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34863 } }
I20260808 07:11:40.441313 32513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a73421852c24e5f907199d855133cc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a73421852c24e5f907199d855133cc3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34863 } } }
I20260808 07:11:40.441438 32513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:40.441309 32514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a73421852c24e5f907199d855133cc3. Latest consensus state: current_term: 1 leader_uuid: "3a73421852c24e5f907199d855133cc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a73421852c24e5f907199d855133cc3" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 34863 } } }
I20260808 07:11:40.441653 32514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:40.441980 32523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:40.442507 32523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:40.444008 32516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:40.440955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42619 (local address 127.9.94.62:34863)
0808 07:11:40.442320 (+ 1365us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:40.442330 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:40.442365 (+ 35us) server_negotiation.cc:407] Connection header received
0808 07:11:40.442483 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:40.442490 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:40.442522 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:40.443007 (+ 485us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:40.443506 (+ 499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:40.443509 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:40.443510 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:40.443513 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:40.443545 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:40.443559 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:40.443626 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:40.443739 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 07:11:40.443784 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1296,"thread_start_us":100,"threads_started":1}
I20260808 07:11:40.444278 32523 catalog_manager.cc:1347] Generated new cluster ID: d491701f0fed4799b67c42d025b3b447
I20260808 07:11:40.444331 32523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:40.444983 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:40.454293 32516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:40.449206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37257 (local address 127.9.94.62:34863)
0808 07:11:40.449251 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:40.449253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:40.453142 (+ 3889us) server_negotiation.cc:407] Connection header received
0808 07:11:40.453229 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:40.453230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:40.453244 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:40.453336 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:40.454007 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:40.454009 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:40.454009 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:40.454013 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:40.454036 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:40.454041 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:40.454103 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:40.454161 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 07:11:40.454177 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:11:40.464373 32523 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:40.464624 32523 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:40.476460 32523 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a73421852c24e5f907199d855133cc3: Generated new TSK 0
I20260808 07:11:40.476698 32523 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:40.486217 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 32437
2026-08-08T07:11:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1460 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:40 dist-test-slave-77v9 krb5kdc[32543](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:40 dist-test-slave-77v9 krb5kdc[32543](info): set up 2 sockets
Aug 08 07:11:40 dist-test-slave-77v9 krb5kdc[32543](info): commencing operation
krb5kdc: starting...
W20260808 07:11:41.603523 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:41 dist-test-slave-77v9 krb5kdc[32543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173101, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:11:41.752628 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:43111
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:44073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:43111
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:41.839083 32558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:41.839347 32558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:41.839390 32558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:41.840622 32558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:41.840693 32558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:41.840719 32558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:41.840749 32558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:41.840780 32558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:41.842360 32558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:44073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:43111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:43111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:41.842645 32558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:41.842886 32558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:41.848104 32564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:41.848258 32563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:41.848308 32558 server_base.cc:1034] running on GCE node
W20260808 07:11:41.848223 32566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:41.848649 32558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:41.849040 32558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:41.850211 32558 hybrid_clock.cc:648] HybridClock initialized: now 1786173101850199 us; error 31 us; skew 500 ppm
Aug 08 07:11:41 dist-test-slave-77v9 krb5kdc[32543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173101, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:41.859380 32558 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:11:41.859978 32558 webserver.cc:460] Webserver started at http://127.9.94.62:38623/ using document root <none> and password file <none>
I20260808 07:11:41.860265 32558 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:41.860318 32558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:41.860499 32558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:41.861752 32558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "1d4a761e17994edb9d1fe35224579488"
format_stamp: "Formatted at 2026-08-08 07:11:41 on dist-test-slave-77v9"
server_key: "1bccfbe02330e081a29ca2e1a5af0e85"
server_key_iv: "eb29fb06ab41983632f40d603283c2ca"
server_key_version: "encryptionkey@0"
I20260808 07:11:41.862138 32558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "1d4a761e17994edb9d1fe35224579488"
format_stamp: "Formatted at 2026-08-08 07:11:41 on dist-test-slave-77v9"
server_key: "1bccfbe02330e081a29ca2e1a5af0e85"
server_key_iv: "eb29fb06ab41983632f40d603283c2ca"
server_key_version: "encryptionkey@0"
I20260808 07:11:41.863754 32558 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:11:41.864692 32576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:41.864950 32558 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:11:41.865075 32558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "1d4a761e17994edb9d1fe35224579488"
format_stamp: "Formatted at 2026-08-08 07:11:41 on dist-test-slave-77v9"
server_key: "1bccfbe02330e081a29ca2e1a5af0e85"
server_key_iv: "eb29fb06ab41983632f40d603283c2ca"
server_key_version: "encryptionkey@0"
I20260808 07:11:41.865161 32558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:41.876634 32558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:41.878904 32558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:41.879074 32558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:41.883423 32558 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:43111
I20260808 07:11:41.883469 32630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:43111 every 8 connection(s)
I20260808 07:11:41.883848 32558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:41.884747 32631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:41.887123 32631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488: Bootstrap starting.
I20260808 07:11:41.887742 32631 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:41.888051 32631 log.cc:824] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:41.888796 32631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488: No bootstrap required, opened a new log
I20260808 07:11:41.889089 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 32558
I20260808 07:11:41.889216 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:41.889410 9592 external_mini_cluster.cc:1428] Setting key 31e6d1ca091acaab88b688cb8f8524af
I20260808 07:11:41.891131 32631 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4a761e17994edb9d1fe35224579488" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43111 } }
I20260808 07:11:41.891324 32631 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:41.891367 32631 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d4a761e17994edb9d1fe35224579488, State: Initialized, Role: FOLLOWER
I20260808 07:11:41.891515 32631 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4a761e17994edb9d1fe35224579488" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43111 } }
I20260808 07:11:41.891580 32631 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:41.891601 32631 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:41.891674 32631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:41.892763 32631 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4a761e17994edb9d1fe35224579488" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43111 } }
I20260808 07:11:41.892892 32631 leader_election.cc:302] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d4a761e17994edb9d1fe35224579488; no voters:
I20260808 07:11:41.893047 32631 leader_election.cc:288] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:41.893101 32638 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:41.893281 32638 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [term 1 LEADER]: Becoming Leader. State: Replica: 1d4a761e17994edb9d1fe35224579488, State: Running, Role: LEADER
I20260808 07:11:41.893302 32631 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:41.893376 32638 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4a761e17994edb9d1fe35224579488" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43111 } }
I20260808 07:11:41.893754 32638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d4a761e17994edb9d1fe35224579488. Latest consensus state: current_term: 1 leader_uuid: "1d4a761e17994edb9d1fe35224579488" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4a761e17994edb9d1fe35224579488" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43111 } } }
I20260808 07:11:41.893826 32638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:41.894131 32643 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:41.894690 32643 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:41.894838 32639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d4a761e17994edb9d1fe35224579488" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4a761e17994edb9d1fe35224579488" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 43111 } } }
I20260808 07:11:41.895092 32639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:41.897193 32643 catalog_manager.cc:1347] Generated new cluster ID: 5f265ca2f4c64406a514dfc9d73c5179
I20260808 07:11:41.897245 32643 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:11:41 dist-test-slave-77v9 krb5kdc[32543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173101, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:41.902590 32637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:41.890013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48889 (local address 127.9.94.62:43111)
0808 07:11:41.890232 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:41.890242 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:41.890275 (+ 33us) server_negotiation.cc:407] Connection header received
0808 07:11:41.891091 (+ 816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:41.891100 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:41.891165 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:41.891317 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:41.892113 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:41.893550 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:41.894634 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:41.895386 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:41.895515 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:41.898542 (+ 3027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:41.898546 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:41.898546 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:41.898557 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:41.900517 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:41.901008 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:41.901012 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:41.901012 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:41.901158 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:41.901384 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:41.901385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:41.901386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:41.901736 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:41.901908 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:41.902004 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 07:11:41.902164 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":105,"threads_started":1}
I20260808 07:11:41.903656 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:41.904771 32643 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:41.905642 32643 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:41.912901 32637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:41.905274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54827 (local address 127.9.94.62:43111)
0808 07:11:41.905311 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:41.905313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:41.905448 (+ 135us) server_negotiation.cc:407] Connection header received
0808 07:11:41.905508 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:41.905509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:41.905637 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:41.905711 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:41.906430 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:41.907172 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:41.908259 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:41.908589 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:41.908651 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:41.910087 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:41.910088 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:41.910088 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:41.910096 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:41.911659 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:41.912078 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:41.912079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:41.912079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:41.912139 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:41.912358 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:41.912359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:41.912359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:41.912485 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:41.912572 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:41.912705 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 07:11:41.912785 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:11:41.923354 32643 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d4a761e17994edb9d1fe35224579488: Generated new TSK 0
I20260808 07:11:41.923590 32643 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:41.930388 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 32558
2026-08-08T07:11:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1443 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:41 dist-test-slave-77v9 krb5kdc[32667](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:41 dist-test-slave-77v9 krb5kdc[32667](info): set up 2 sockets
Aug 08 07:11:41 dist-test-slave-77v9 krb5kdc[32667](info): commencing operation
krb5kdc: starting...
W20260808 07:11:43.055259 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:43 dist-test-slave-77v9 krb5kdc[32667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173103, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:11:43.205266 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:45071
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:42437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:45071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:43.298719 32682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:43.299110 32682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:43.299160 32682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:43.300698 32682 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:43.300806 32682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:43.300860 32682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:43.300899 32682 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:43.300927 32682 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:43.302768 32682 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:42437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:45071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:45071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:43.303097 32682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:43.303367 32682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:43.309389 32688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:43.309396 32690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:43.309466 32682 server_base.cc:1034] running on GCE node
W20260808 07:11:43.309399 32687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:43.310104 32682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:43.310405 32682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:43.311578 32682 hybrid_clock.cc:648] HybridClock initialized: now 1786173103311563 us; error 32 us; skew 500 ppm
Aug 08 07:11:43 dist-test-slave-77v9 krb5kdc[32667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173103, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:43.314661 32682 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:11:43.315219 32682 webserver.cc:460] Webserver started at http://127.9.94.62:35227/ using document root <none> and password file <none>
I20260808 07:11:43.315476 32682 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:43.315550 32682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:43.315709 32682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:43.317050 32682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "21d138a12ccd481e8441e9cc8c8f8c02"
format_stamp: "Formatted at 2026-08-08 07:11:43 on dist-test-slave-77v9"
server_key: "f93997a95b9c2e0a3ff619224e419536"
server_key_iv: "936973d21581c02f6730d1ccac009bc6"
server_key_version: "encryptionkey@0"
I20260808 07:11:43.317457 32682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "21d138a12ccd481e8441e9cc8c8f8c02"
format_stamp: "Formatted at 2026-08-08 07:11:43 on dist-test-slave-77v9"
server_key: "f93997a95b9c2e0a3ff619224e419536"
server_key_iv: "936973d21581c02f6730d1ccac009bc6"
server_key_version: "encryptionkey@0"
I20260808 07:11:43.319043 32682 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:11:43.319931 32698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:43.320214 32682 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:43.320365 32682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "21d138a12ccd481e8441e9cc8c8f8c02"
format_stamp: "Formatted at 2026-08-08 07:11:43 on dist-test-slave-77v9"
server_key: "f93997a95b9c2e0a3ff619224e419536"
server_key_iv: "936973d21581c02f6730d1ccac009bc6"
server_key_version: "encryptionkey@0"
I20260808 07:11:43.320453 32682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:43.336738 32682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:43.339437 32682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:43.339668 32682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:43.344456 32682 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:45071
I20260808 07:11:43.344497 32754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:45071 every 8 connection(s)
I20260808 07:11:43.344933 32682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:43.345948 32755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:43.348415 32755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02: Bootstrap starting.
I20260808 07:11:43.349095 32755 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:43.349448 32755 log.cc:824] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:43.350318 32755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02: No bootstrap required, opened a new log
I20260808 07:11:43.352130 32755 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21d138a12ccd481e8441e9cc8c8f8c02" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45071 } }
I20260808 07:11:43.352284 32755 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:43.352308 32755 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d138a12ccd481e8441e9cc8c8f8c02, State: Initialized, Role: FOLLOWER
I20260808 07:11:43.352461 32755 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21d138a12ccd481e8441e9cc8c8f8c02" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45071 } }
I20260808 07:11:43.352567 32755 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:43.352608 32755 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:43.352658 32755 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:43.352705 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 32682
I20260808 07:11:43.352847 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:43.353128 9592 external_mini_cluster.cc:1428] Setting key d313bd8371b6042015dc3308646bbf1c
I20260808 07:11:43.353976 32755 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21d138a12ccd481e8441e9cc8c8f8c02" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45071 } }
I20260808 07:11:43.354097 32755 leader_election.cc:302] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21d138a12ccd481e8441e9cc8c8f8c02; no voters:
I20260808 07:11:43.354282 32755 leader_election.cc:288] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:43.354331 32761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:43.354640 32755 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:43.354686 32761 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [term 1 LEADER]: Becoming Leader. State: Replica: 21d138a12ccd481e8441e9cc8c8f8c02, State: Running, Role: LEADER
I20260808 07:11:43.354910 32761 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21d138a12ccd481e8441e9cc8c8f8c02" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45071 } }
I20260808 07:11:43.355392 32763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21d138a12ccd481e8441e9cc8c8f8c02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21d138a12ccd481e8441e9cc8c8f8c02" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45071 } } }
I20260808 07:11:43.355536 32763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:43.355685 32763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21d138a12ccd481e8441e9cc8c8f8c02. Latest consensus state: current_term: 1 leader_uuid: "21d138a12ccd481e8441e9cc8c8f8c02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21d138a12ccd481e8441e9cc8c8f8c02" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 45071 } } }
I20260808 07:11:43.355731 32763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:43.356175 303 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:43.356875 303 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:43.359197 303 catalog_manager.cc:1347] Generated new cluster ID: c99265b782604cf4a2e32c8ad934ee45
I20260808 07:11:43.359313 303 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:43.360019 32760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:43.353726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49473 (local address 127.9.94.62:45071)
0808 07:11:43.353954 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:43.353962 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:43.353992 (+ 30us) server_negotiation.cc:407] Connection header received
0808 07:11:43.354119 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:43.354127 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:43.354208 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:43.354369 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:43.354621 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:43.356265 (+ 1644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:43.357350 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:43.357981 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:43.358113 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:43.359030 (+ 917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:43.359034 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:43.359035 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:43.359380 (+ 345us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:43.359427 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:43.359444 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:43.359530 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:43.359615 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 07:11:43.359788 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":122,"threads_started":1}
I20260808 07:11:43.360971 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:43.369377 32760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:43.365143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39533 (local address 127.9.94.62:45071)
0808 07:11:43.365189 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:43.365192 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:43.365356 (+ 164us) server_negotiation.cc:407] Connection header received
0808 07:11:43.365416 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:43.365417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:43.365441 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:43.365506 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:43.365662 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:43.366565 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:43.367921 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:43.368255 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:43.368337 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:43.369097 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:43.369099 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:43.369099 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:43.369105 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:43.369124 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:43.369130 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:43.369186 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:43.369253 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 07:11:43.369284 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:11:43.385870 303 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:43.386577 303 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:43.391237 303 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21d138a12ccd481e8441e9cc8c8f8c02: Generated new TSK 0
I20260808 07:11:43.391500 303 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:43.399674 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 32682
2026-08-08T07:11:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1469 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:43 dist-test-slave-77v9 krb5kdc[323](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:43 dist-test-slave-77v9 krb5kdc[323](info): set up 2 sockets
Aug 08 07:11:43 dist-test-slave-77v9 krb5kdc[323](info): commencing operation
krb5kdc: starting...
W20260808 07:11:44.520606 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:44 dist-test-slave-77v9 krb5kdc[323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:11:44.661047 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:40637
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:35623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:40637
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:44.755084 339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:44.755311 339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:44.755335 339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:44.756486 339 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:44.756536 339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:44.756551 339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:44.756565 339 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:44.756618 339 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:44.758252 339 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:35623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:40637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:40637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:44.758548 339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:44.758793 339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:44.764941 348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:44.764990 346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:44.764941 345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:44.765211 339 server_base.cc:1034] running on GCE node
I20260808 07:11:44.765468 339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:44.765844 339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:44.767048 339 hybrid_clock.cc:648] HybridClock initialized: now 1786173104767017 us; error 49 us; skew 500 ppm
Aug 08 07:11:44 dist-test-slave-77v9 krb5kdc[323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173104, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:44.769797 339 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:11:44.770234 339 webserver.cc:460] Webserver started at http://127.9.94.62:44359/ using document root <none> and password file <none>
I20260808 07:11:44.770452 339 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:44.770538 339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:44.770673 339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:44.771776 339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "0fa86f311aa84e94b3b81390563a5a29"
format_stamp: "Formatted at 2026-08-08 07:11:44 on dist-test-slave-77v9"
server_key: "6c63a4bb49594d05f61e04592b10999a"
server_key_iv: "32e946406ad07f7c824d293981bc9388"
server_key_version: "encryptionkey@0"
I20260808 07:11:44.772174 339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "0fa86f311aa84e94b3b81390563a5a29"
format_stamp: "Formatted at 2026-08-08 07:11:44 on dist-test-slave-77v9"
server_key: "6c63a4bb49594d05f61e04592b10999a"
server_key_iv: "32e946406ad07f7c824d293981bc9388"
server_key_version: "encryptionkey@0"
I20260808 07:11:44.773869 339 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:11:44.774995 356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:44.775321 339 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:44.775439 339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "0fa86f311aa84e94b3b81390563a5a29"
format_stamp: "Formatted at 2026-08-08 07:11:44 on dist-test-slave-77v9"
server_key: "6c63a4bb49594d05f61e04592b10999a"
server_key_iv: "32e946406ad07f7c824d293981bc9388"
server_key_version: "encryptionkey@0"
I20260808 07:11:44.775529 339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:44.779541 339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:44.782248 339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:44.782457 339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:44.787489 339 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:40637
I20260808 07:11:44.787669 415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:40637 every 8 connection(s)
I20260808 07:11:44.787942 339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:44.788360 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 339
I20260808 07:11:44.788544 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:44.788791 9592 external_mini_cluster.cc:1428] Setting key 46498e916373672fdc342e73013ab3b0
I20260808 07:11:44.789307 416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:44.791533 420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:44.789449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45591 (local address 127.9.94.62:40637)
0808 07:11:44.789640 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:44.789647 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:44.789673 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:11:44.790136 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:44.790143 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:44.790168 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:44.790289 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:44.791016 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:44.791019 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:44.791020 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:44.791024 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:44.791072 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:44.791084 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:44.791155 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:44.791248 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 07:11:44.791320 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":95,"threads_started":1}
I20260808 07:11:44.792598 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:44.792912 416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29: Bootstrap starting.
I20260808 07:11:44.793718 416 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:44.794116 416 log.cc:824] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:44.794968 416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29: No bootstrap required, opened a new log
I20260808 07:11:44.797148 416 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa86f311aa84e94b3b81390563a5a29" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40637 } }
I20260808 07:11:44.797317 416 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:11:44.797348 416 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa86f311aa84e94b3b81390563a5a29, State: Initialized, Role: FOLLOWER
I20260808 07:11:44.797516 416 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa86f311aa84e94b3b81390563a5a29" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40637 } }
I20260808 07:11:44.797636 416 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:11:44.797683 416 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:11:44.797734 416 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:44.798017 420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:44.794401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45265 (local address 127.9.94.62:40637)
0808 07:11:44.794437 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:44.794439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:44.794584 (+ 145us) server_negotiation.cc:407] Connection header received
0808 07:11:44.794666 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:44.794666 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:44.794671 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:44.794705 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:44.797717 (+ 3012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:44.797719 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:44.797719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:11:44.797725 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:44.797743 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:11:44.797748 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:44.797887 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:44.797955 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 07:11:44.797968 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:11:44.798635 416 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa86f311aa84e94b3b81390563a5a29" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40637 } }
I20260808 07:11:44.798735 416 leader_election.cc:302] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fa86f311aa84e94b3b81390563a5a29; no voters:
I20260808 07:11:44.798903 416 leader_election.cc:288] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:11:44.798943 427 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:44.799082 427 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [term 1 LEADER]: Becoming Leader. State: Replica: 0fa86f311aa84e94b3b81390563a5a29, State: Running, Role: LEADER
I20260808 07:11:44.799178 427 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa86f311aa84e94b3b81390563a5a29" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40637 } }
I20260808 07:11:44.799202 416 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:44.799612 429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fa86f311aa84e94b3b81390563a5a29. Latest consensus state: current_term: 1 leader_uuid: "0fa86f311aa84e94b3b81390563a5a29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa86f311aa84e94b3b81390563a5a29" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40637 } } }
I20260808 07:11:44.799683 428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fa86f311aa84e94b3b81390563a5a29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa86f311aa84e94b3b81390563a5a29" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 40637 } } }
I20260808 07:11:44.799930 428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:44.799734 429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:44.800318 439 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:44.801020 439 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:44.802665 439 catalog_manager.cc:1347] Generated new cluster ID: 438163ddbe2e4072b92b60f57c740f81
I20260808 07:11:44.802722 439 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:44.811077 439 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:44.811249 439 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:44.821282 439 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fa86f311aa84e94b3b81390563a5a29: Generated new TSK 0
I20260808 07:11:44.821484 439 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:11:44.833262 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 339
2026-08-08T07:11:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1432 ms)
[----------] 18 tests from AuthTokenIssuingTest (26524 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:44 dist-test-slave-77v9 krb5kdc[453](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:44 dist-test-slave-77v9 krb5kdc[453](info): set up 2 sockets
Aug 08 07:11:44 dist-test-slave-77v9 krb5kdc[453](info): commencing operation
krb5kdc: starting...
W20260808 07:11:46.013530 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:11:46.157760 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:38835
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:33687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:38835,127.9.94.61:37945,127.9.94.60:43475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:46.247082 466 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:11:46.247373 466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:46.247406 466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:46.247450 466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:46.248634 466 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:46.248786 466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:46.248867 466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:46.248893 466 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:46.248921 466 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:46.250594 466 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:33687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:38835,127.9.94.61:37945,127.9.94.60:43475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:38835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:46.250897 466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:46.251140 466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:11:46.257383 466 server_base.cc:1034] running on GCE node
W20260808 07:11:46.257570 472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:46.257649 474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:46.257592 471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:46.258000 466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:46.258366 466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:46.259577 466 hybrid_clock.cc:648] HybridClock initialized: now 1786173106259556 us; error 34 us; skew 500 ppm
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:46.262451 466 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:11:46.262943 466 webserver.cc:460] Webserver started at http://127.9.94.62:46403/ using document root <none> and password file <none>
I20260808 07:11:46.263190 466 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:46.263260 466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:46.263412 466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:46.264528 466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "4763db6937bf44b4b72a9034bc712c3f"
format_stamp: "Formatted at 2026-08-08 07:11:46 on dist-test-slave-77v9"
server_key: "22b177299eba3abc79e3e5744ec29a82"
server_key_iv: "33eea4c6e7f777600eb4b83f4faf002e"
server_key_version: "encryptionkey@0"
I20260808 07:11:46.264966 466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "4763db6937bf44b4b72a9034bc712c3f"
format_stamp: "Formatted at 2026-08-08 07:11:46 on dist-test-slave-77v9"
server_key: "22b177299eba3abc79e3e5744ec29a82"
server_key_iv: "33eea4c6e7f777600eb4b83f4faf002e"
server_key_version: "encryptionkey@0"
I20260808 07:11:46.266445 466 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:11:46.267349 483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:46.267639 466 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:46.267750 466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "4763db6937bf44b4b72a9034bc712c3f"
format_stamp: "Formatted at 2026-08-08 07:11:46 on dist-test-slave-77v9"
server_key: "22b177299eba3abc79e3e5744ec29a82"
server_key_iv: "33eea4c6e7f777600eb4b83f4faf002e"
server_key_version: "encryptionkey@0"
I20260808 07:11:46.267833 466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:46.290128 466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:46.292536 466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:46.292734 466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:46.297180 466 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:38835
I20260808 07:11:46.297225 539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:38835 every 8 connection(s)
I20260808 07:11:46.297607 466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:46.299156 540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:46.300956 540 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:11:46.304952 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 466
I20260808 07:11:46.305096 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:46.305292 9592 external_mini_cluster.cc:1428] Setting key 089b5d03b490109653c9cf5e64e8b0a8
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:46.313601 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.301904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42044 (local address 127.9.94.62:38835)
0808 07:11:46.302058 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.302063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.302101 (+ 38us) server_negotiation.cc:407] Connection header received
0808 07:11:46.302754 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.302756 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.302774 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.302882 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.303512 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.304432 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.305982 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.306494 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.306834 (+ 340us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.309500 (+ 2666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:46.309511 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:46.309511 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:46.309521 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:46.311725 (+ 2204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.312178 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.312182 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.312182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.312295 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.312569 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.312570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.312571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.312947 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:46.313040 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:46.313249 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 07:11:46.313428 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":108,"thread_start_us":51,"threads_started":1}
I20260808 07:11:46.313609 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.301698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:38835 (local address 127.0.0.1:42044)
0808 07:11:46.301920 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.301991 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:46.302556 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:46.302889 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:46.302892 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:46.303211 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:46.303395 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.303399 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.304540 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.304540 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.305802 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.305806 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.306847 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.306850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.306978 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.307759 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:46.307768 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:46.309393 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:46.311856 (+ 2463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.311863 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.311865 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.312088 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.312395 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.312396 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.312397 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.312491 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.313037 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:46.313044 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:46.313110 (+ 66us) client_negotiation.cc:769] Sending connection context
0808 07:11:46.313190 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 07:11:46.313341 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":84,"threads_started":1}
I20260808 07:11:46.314693 540 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.9.94.61@KRBTEST.COM; defaulting to no policy
I20260808 07:11:46.315141 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.315016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:37945 (local address 127.0.0.1:48854)
0808 07:11:46.315068 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.315119 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:37945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 07:11:46.315366 486 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.94.61:37945: connect: Connection refused (error 111)
I20260808 07:11:46.315894 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.315777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:37945 (local address 127.0.0.1:48868)
0808 07:11:46.315846 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.315876 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:37945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 07:11:46.316048 540 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.61:37945: Network error: Client connection negotiation failed: client connection to 127.9.94.61:37945: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.61.keytab.
Entry for principal kudu/127.9.94.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.61.keytab.
I20260808 07:11:46.336700 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.61:37945
--webserver_interface=127.9.94.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.61.keytab
--principal=kudu/127.9.94.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:33687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:38835,127.9.94.61:37945,127.9.94.60:43475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:11:46.365341 540 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } attempt: 1
I20260808 07:11:46.365872 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.365730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:37945 (local address 127.0.0.1:48870)
0808 07:11:46.365796 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.365842 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:37945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 07:11:46.366230 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.366131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:37945 (local address 127.0.0.1:48886)
0808 07:11:46.366176 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.366209 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:37945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 07:11:46.366318 540 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.61:37945: Network error: Client connection negotiation failed: client connection to 127.9.94.61:37945: connect: Connection refused (error 111)
W20260808 07:11:46.429525 547 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:11:46.429849 547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:46.429886 547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:46.429934 547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:46.431200 547 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:46.431273 547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:46.431311 547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:46.431345 547 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:46.431370 547 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:46.433094 547 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:33687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:38835,127.9.94.61:37945,127.9.94.60:43475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.61.keytab
--principal=kudu/127.9.94.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.61:37945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.94.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:46.433424 547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:46.433686 547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:11:46.434482 540 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } attempt: 2
I20260808 07:11:46.435096 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.434941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:37945 (local address 127.0.0.1:48898)
0808 07:11:46.435013 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.435056 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:37945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 07:11:46.435536 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.435449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:37945 (local address 127.0.0.1:48914)
0808 07:11:46.435492 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.435519 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:37945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 07:11:46.435645 540 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.61:37945: Network error: Client connection negotiation failed: client connection to 127.9.94.61:37945: connect: Connection refused (error 111)
W20260808 07:11:46.439596 556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:46.439671 547 server_base.cc:1034] running on GCE node
W20260808 07:11:46.439591 554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:46.439589 553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:46.440299 547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:46.440689 547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:46.441891 547 hybrid_clock.cc:648] HybridClock initialized: now 1786173106441866 us; error 37 us; skew 500 ppm
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:46.444798 547 init.cc:377] Logged in from keytab as kudu/127.9.94.61@KRBTEST.COM (short username kudu)
I20260808 07:11:46.445336 547 webserver.cc:460] Webserver started at http://127.9.94.61:42921/ using document root <none> and password file <none>
I20260808 07:11:46.445570 547 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:46.445636 547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:46.445791 547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:46.447134 547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/data/instance:
uuid: "27e7f90432734ccf9d1d8a13f1a68957"
format_stamp: "Formatted at 2026-08-08 07:11:46 on dist-test-slave-77v9"
server_key: "9d7505121ee91c788783fc2c9eea2259"
server_key_iv: "93d7aaf82e4df46b9f507b71d595ec13"
server_key_version: "encryptionkey@0"
I20260808 07:11:46.447585 547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/wal/instance:
uuid: "27e7f90432734ccf9d1d8a13f1a68957"
format_stamp: "Formatted at 2026-08-08 07:11:46 on dist-test-slave-77v9"
server_key: "9d7505121ee91c788783fc2c9eea2259"
server_key_iv: "93d7aaf82e4df46b9f507b71d595ec13"
server_key_version: "encryptionkey@0"
I20260808 07:11:46.449360 547 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260808 07:11:46.450595 563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:46.450913 547 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:11:46.451249 547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/wal
uuid: "27e7f90432734ccf9d1d8a13f1a68957"
format_stamp: "Formatted at 2026-08-08 07:11:46 on dist-test-slave-77v9"
server_key: "9d7505121ee91c788783fc2c9eea2259"
server_key_iv: "93d7aaf82e4df46b9f507b71d595ec13"
server_key_version: "encryptionkey@0"
I20260808 07:11:46.451378 547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:46.477644 547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:46.480223 547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:46.480454 547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:46.485100 547 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.61:37945
I20260808 07:11:46.485162 621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.61:37945 every 8 connection(s)
I20260808 07:11:46.485544 547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/data/info.pb
I20260808 07:11:46.486634 622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:46.488368 622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:11:46.493969 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 547
I20260808 07:11:46.494076 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-1/wal/instance
I20260808 07:11:46.494216 9592 external_mini_cluster.cc:1428] Setting key b75f2f3834c33652ada9d606b4c00873
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.61@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:46.499754 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.489168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42060 (local address 127.9.94.62:38835)
0808 07:11:46.489215 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.489217 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.489453 (+ 236us) server_negotiation.cc:407] Connection header received
0808 07:11:46.490028 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.490029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.490048 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.490167 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.490831 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.491417 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.492876 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.493202 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.493276 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.495917 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:46.495919 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:46.495920 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:46.495938 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:46.498009 (+ 2071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.498500 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.498501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.498502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.498578 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.498879 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.498880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.498880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.499076 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:46.499167 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:46.499477 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 07:11:46.499596 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:11:46.499783 624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.489129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:38835 (local address 127.0.0.1:42060)
0808 07:11:46.489309 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.489352 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:46.489814 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:46.490243 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:46.490247 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:46.490528 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:46.490736 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.490739 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.491519 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.491520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.492701 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.492704 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.493338 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.493339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.493476 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.494209 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:46.494226 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:46.495791 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:46.498126 (+ 2335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.498134 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.498136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.498412 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.498663 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.498663 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.498664 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.498799 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.499170 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:46.499177 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:46.499314 (+ 137us) client_negotiation.cc:769] Sending connection context
0808 07:11:46.499440 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 07:11:46.499599 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":99,"threads_started":1}
I20260808 07:11:46.500730 622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.9.94.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.60@KRBTEST.COM" created.
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.61@KRBTEST.COM for kudu/127.9.94.61@KRBTEST.COM
I20260808 07:11:46.512454 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.501195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48924 (local address 127.9.94.61:37945)
0808 07:11:46.501450 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.501454 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.501473 (+ 19us) server_negotiation.cc:407] Connection header received
0808 07:11:46.501491 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.501493 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.501504 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.501615 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.501948 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.502632 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.503304 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.503639 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.503727 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.508311 (+ 4584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:46.508328 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:46.508328 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:46.508342 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:46.510753 (+ 2411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.511214 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.511218 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.511218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.511317 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.511539 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.511540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.511540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.511778 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:46.511959 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:46.512123 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 07:11:46.512302 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":223,"thread_start_us":125,"threads_started":1}
I20260808 07:11:46.512530 624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.501107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:37945 (local address 127.0.0.1:48924)
0808 07:11:46.501172 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.501182 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:46.501224 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:46.501618 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:46.501619 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:46.501767 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:46.501828 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.501830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.502723 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.502724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.503217 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.503218 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.503724 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.503725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.503791 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.504406 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:46.504415 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:46.508174 (+ 3759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:46.510886 (+ 2712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.510887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.510888 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.511097 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.511403 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.511404 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.511404 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.511472 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.511934 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:46.511935 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:46.511986 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 07:11:46.512085 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 07:11:46.512376 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":154}
I20260808 07:11:46.513818 622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:11:46.514274 624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.514101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:43475 (local address 127.0.0.1:37076)
0808 07:11:46.514151 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.514238 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 07:11:46.514439 565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
I20260808 07:11:46.514957 624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.514790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:43475 (local address 127.0.0.1:37090)
0808 07:11:46.514886 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.514928 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 07:11:46.515069 622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:43475: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
I20260808 07:11:46.526846 540 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.60.keytab.
Entry for principal kudu/127.9.94.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.60.keytab.
I20260808 07:11:46.529773 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.60:43475
--webserver_interface=127.9.94.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.60.keytab
--principal=kudu/127.9.94.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:33687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:38835,127.9.94.61:37945,127.9.94.60:43475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for kudu/127.9.94.61@KRBTEST.COM
I20260808 07:11:46.536339 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.527380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48936 (local address 127.9.94.61:37945)
0808 07:11:46.527503 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.527505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.527514 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:11:46.527549 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.527550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.527562 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.527627 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.528009 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.528609 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.529816 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.530162 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.530234 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.533285 (+ 3051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:46.533287 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:46.533287 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:46.533297 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:46.534987 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.535441 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.535443 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.535444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.535507 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.535728 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.535729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.535729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.535865 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:46.535953 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:46.536140 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 07:11:46.536231 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 07:11:46.536339 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.527258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:37945 (local address 127.0.0.1:48936)
0808 07:11:46.527345 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.527359 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:46.527432 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:46.527648 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:46.527650 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:46.527839 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:46.527918 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.527920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.528700 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.528701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.529680 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.529684 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.530266 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.530267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.530391 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.530934 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:46.530941 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:46.533164 (+ 2223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:46.535118 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.535119 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.535120 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.535329 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.535591 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.535592 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.535592 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.535659 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.535958 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:46.535959 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:46.536014 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 07:11:46.536097 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 07:11:46.536221 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 07:11:46.536841 540 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:11:46.537479 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.537300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:43475 (local address 127.0.0.1:37104)
0808 07:11:46.537391 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.537442 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 07:11:46.538048 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.537924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:43475 (local address 127.0.0.1:37116)
0808 07:11:46.537976 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.538013 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 07:11:46.538203 540 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:43475: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
I20260808 07:11:46.564314 622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } attempt: 1
I20260808 07:11:46.564918 624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.564726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:43475 (local address 127.0.0.1:37126)
0808 07:11:46.564821 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.564877 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 07:11:46.565394 624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.565267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:43475 (local address 127.0.0.1:37136)
0808 07:11:46.565320 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.565362 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 07:11:46.565558 622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:43475: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
I20260808 07:11:46.569365 540 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } attempt: 1
I20260808 07:11:46.569871 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.569723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:43475 (local address 127.0.0.1:37138)
0808 07:11:46.569790 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.569837 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 07:11:46.570245 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.570146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:43475 (local address 127.0.0.1:37140)
0808 07:11:46.570193 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.570223 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 07:11:46.570379 540 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:43475: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
W20260808 07:11:46.628707 629 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:11:46.629006 629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:46.629025 629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:46.629047 629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:46.630165 629 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:46.630208 629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:46.630223 629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:46.630236 629 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:46.630249 629 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:46.631834 629 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:33687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:38835,127.9.94.61:37945,127.9.94.60:43475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.60.keytab
--principal=kudu/127.9.94.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.60:43475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.94.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:46.632064 629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:46.632261 629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:11:46.633826 622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } attempt: 2
I20260808 07:11:46.634572 624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.634373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:43475 (local address 127.0.0.1:37146)
0808 07:11:46.634462 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.634515 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 07:11:46.635095 624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.634873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:43475 (local address 127.0.0.1:37150)
0808 07:11:46.634921 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.635045 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 07:11:46.635342 622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:43475: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
W20260808 07:11:46.637827 635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:46.638077 634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:46.638077 637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:46.638208 629 server_base.cc:1034] running on GCE node
I20260808 07:11:46.638484 629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:46.638900 629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:46.640089 629 hybrid_clock.cc:648] HybridClock initialized: now 1786173106640058 us; error 45 us; skew 500 ppm
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:46.642948 629 init.cc:377] Logged in from keytab as kudu/127.9.94.60@KRBTEST.COM (short username kudu)
I20260808 07:11:46.643476 629 webserver.cc:460] Webserver started at http://127.9.94.60:40655/ using document root <none> and password file <none>
I20260808 07:11:46.643756 629 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:46.643827 629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:46.643971 629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:46.645208 629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/data/instance:
uuid: "aea09c802ee04742a5f827337d9ca751"
format_stamp: "Formatted at 2026-08-08 07:11:46 on dist-test-slave-77v9"
server_key: "2965196637fe54e9c84563eddbb19a55"
server_key_iv: "047035974abdfb4602399394536f4f59"
server_key_version: "encryptionkey@0"
I20260808 07:11:46.645534 540 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } attempt: 2
I20260808 07:11:46.645740 629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/wal/instance:
uuid: "aea09c802ee04742a5f827337d9ca751"
format_stamp: "Formatted at 2026-08-08 07:11:46 on dist-test-slave-77v9"
server_key: "2965196637fe54e9c84563eddbb19a55"
server_key_iv: "047035974abdfb4602399394536f4f59"
server_key_version: "encryptionkey@0"
I20260808 07:11:46.646004 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.645825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:43475 (local address 127.0.0.1:37152)
0808 07:11:46.645888 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.645962 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 07:11:46.646524 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.646380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:43475 (local address 127.0.0.1:37168)
0808 07:11:46.646446 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.646477 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 07:11:46.646638 540 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:43475: Network error: Client connection negotiation failed: client connection to 127.9.94.60:43475: connect: Connection refused (error 111)
I20260808 07:11:46.647879 629 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260808 07:11:46.649264 644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:46.649492 629 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:11:46.649600 629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/wal
uuid: "aea09c802ee04742a5f827337d9ca751"
format_stamp: "Formatted at 2026-08-08 07:11:46 on dist-test-slave-77v9"
server_key: "2965196637fe54e9c84563eddbb19a55"
server_key_iv: "047035974abdfb4602399394536f4f59"
server_key_version: "encryptionkey@0"
I20260808 07:11:46.649675 629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:46.667057 629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:46.670107 629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:46.670318 629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:46.675282 629 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.60:43475
I20260808 07:11:46.675338 702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.60:43475 every 8 connection(s)
I20260808 07:11:46.675716 629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/data/info.pb
I20260808 07:11:46.676975 703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:46.677883 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 629
I20260808 07:11:46.677997 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172813832116-9592-0/minicluster-data/master-2/wal/instance
I20260808 07:11:46.678174 9592 external_mini_cluster.cc:1428] Setting key 034f334c1dd47ec3e26f49c7f19bb07f
I20260808 07:11:46.679164 703 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.60@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.60@KRBTEST.COM
I20260808 07:11:46.689353 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.680374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42062 (local address 127.9.94.62:38835)
0808 07:11:46.680454 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.680457 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.680637 (+ 180us) server_negotiation.cc:407] Connection header received
0808 07:11:46.680726 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.680727 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.680738 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.680797 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.681387 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.681900 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.682949 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.683171 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.683250 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.685759 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:46.685761 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:46.685766 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:46.685773 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:46.687482 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.687985 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.687986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.687987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.688060 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.688379 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.688380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.688380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.688561 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:46.688652 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:46.689145 (+ 493us) server_negotiation.cc:299] Negotiation successful
0808 07:11:46.689249 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 07:11:46.689565 707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.680262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:38835 (local address 127.0.0.1:42062)
0808 07:11:46.680526 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.680568 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:46.680657 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:46.680866 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:46.680869 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:46.681172 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:46.681275 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.681279 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.682006 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.682007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.682856 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.682859 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.683279 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.683281 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.683359 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.684023 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:46.684031 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:46.685652 (+ 1621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:46.687597 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.687606 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.687608 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.687871 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.688134 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.688135 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.688136 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.688296 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.688700 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:46.688709 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:46.688995 (+ 286us) client_negotiation.cc:769] Sending connection context
0808 07:11:46.689091 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 07:11:46.689292 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":5,"thread_start_us":154,"threads_started":1}
I20260808 07:11:46.690052 706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.678794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37170 (local address 127.9.94.60:43475)
0808 07:11:46.679009 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.679019 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.679053 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:11:46.679495 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.679502 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.679549 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.679699 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.680691 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.681675 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.682626 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.683005 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.683150 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.686289 (+ 3139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:46.686298 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:46.686298 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:46.686307 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:46.688125 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.688519 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.688523 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.688523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.688587 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.688967 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.688968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.688968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.689146 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:46.689333 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:46.689810 (+ 477us) server_negotiation.cc:299] Negotiation successful
0808 07:11:46.689900 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":160,"thread_start_us":106,"threads_started":1}
I20260808 07:11:46.690335 703 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.60@KRBTEST.COM for kudu/127.9.94.61@KRBTEST.COM
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:46.699566 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.690761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48948 (local address 127.9.94.61:37945)
0808 07:11:46.690828 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.690830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.690983 (+ 153us) server_negotiation.cc:407] Connection header received
0808 07:11:46.691062 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.691063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.691073 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.691131 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.691395 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.691874 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.692720 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.693050 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.693145 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.695690 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:46.695693 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:46.695693 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:46.695705 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:46.697846 (+ 2141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.698463 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.698465 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.698465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.698541 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.698843 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.698845 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.698845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.699051 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:46.699133 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:46.699383 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 07:11:46.699475 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:11:46.699584 707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.690664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:37945 (local address 127.0.0.1:48948)
0808 07:11:46.690896 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.690938 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:46.690996 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:46.691134 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:46.691135 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:46.691289 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:46.691324 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.691325 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.692062 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.692063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.692613 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.692615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.693145 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.693146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.693213 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.693748 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:46.693753 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:46.695514 (+ 1761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:46.697990 (+ 2476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.697993 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.697994 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.698318 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.698628 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.698630 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.698631 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.698740 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.699178 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:46.699179 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:46.699238 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 07:11:46.699332 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 07:11:46.699455 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213}
I20260808 07:11:46.700150 703 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:11:46.700428 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.690897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42068 (local address 127.9.94.62:38835)
0808 07:11:46.690932 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.690934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.690993 (+ 59us) server_negotiation.cc:407] Connection header received
0808 07:11:46.691066 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.691067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.691076 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.691131 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.691617 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.692070 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.692724 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.692996 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.693067 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.696563 (+ 3496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:46.696565 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:46.696565 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:46.696573 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:46.698707 (+ 2134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.699188 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.699189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.699189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.699286 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.699502 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.699503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.699503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.699645 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:46.699866 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:46.700138 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 07:11:46.700262 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.60@KRBTEST.COM for kudu/127.9.94.60@KRBTEST.COM
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.61@KRBTEST.COM
I20260808 07:11:46.707594 706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.700506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37178 (local address 127.9.94.60:43475)
0808 07:11:46.700552 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.700554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.700563 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:11:46.700614 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.700615 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.700627 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.700683 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.700967 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.701583 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.702232 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.702445 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.702529 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.704307 (+ 1778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:46.704309 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:46.704309 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:46.704317 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:46.706213 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.706617 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.706618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.706619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.706680 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.706995 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.706996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.706996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.707165 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:46.707254 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:46.707444 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 07:11:46.707527 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:11:46.707715 707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.700454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:43475 (local address 127.0.0.1:37178)
0808 07:11:46.700501 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.700512 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:46.700553 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:46.700684 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:46.700685 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:46.700858 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:46.700898 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.700900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.701657 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.701658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.702143 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.702145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.702533 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.702535 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.702583 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.703008 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:46.703012 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:46.704225 (+ 1213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:46.706286 (+ 2061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.706287 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.706287 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.706539 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.706753 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.706754 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.706754 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.706858 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.707270 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:46.707271 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:46.707321 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 07:11:46.707407 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 07:11:46.707600 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":61}
I20260808 07:11:46.709672 703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751: Bootstrap starting.
I20260808 07:11:46.709821 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.701465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48950 (local address 127.9.94.61:37945)
0808 07:11:46.701507 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.701509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.701518 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:11:46.701541 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.701542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.701552 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.701600 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.702060 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.702513 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.703185 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.703390 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.703465 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.706179 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:46.706181 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:46.706181 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:46.706188 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:46.708137 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.708542 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.708544 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.708544 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.708610 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.709179 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.709180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.709181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.709353 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:46.709559 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:46.709638 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 07:11:46.709722 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:11:46.710810 703 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:46.711189 703 log.cc:824] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:46.711795 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:46.712169 703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751: No bootstrap required, opened a new log
I20260808 07:11:46.713116 512 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "4763db6937bf44b4b72a9034bc712c3f"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42068
I20260808 07:11:46.714110 703 raft_consensus.cc:348] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } }
I20260808 07:11:46.714284 703 raft_consensus.cc:729] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aea09c802ee04742a5f827337d9ca751, State: Initialized, Role: FOLLOWER
I20260808 07:11:46.714393 703 consensus_queue.cc:260] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } }
I20260808 07:11:46.714762 703 sys_catalog.cc:564] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:46.714748 709 sys_catalog.cc:455] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } } }
I20260808 07:11:46.714864 709 sys_catalog.cc:458] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:11:46.716691 721 catalog_manager.cc:1558] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:11:46.716756 721 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:11:46.717103 629 master_runner.cc:186] Error getting master registration for 127.9.94.62:38835: OK, instance_id { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" instance_seqno: 1786173106295904 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:11:46.720016 629 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:11:46.726512 622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } attempt: 3
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.61@KRBTEST.COM for kudu/127.9.94.60@KRBTEST.COM
I20260808 07:11:46.735112 624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.726985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:43475 (local address 127.0.0.1:37190)
0808 07:11:46.727061 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.727076 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:46.727159 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:46.727323 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:46.727325 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:46.727579 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:46.727640 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.727642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.728553 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.728555 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.729552 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.729556 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.730036 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.730037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.730104 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.730655 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:46.730661 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:46.732315 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:46.734008 (+ 1693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.734009 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.734009 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.734188 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.734394 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.734395 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.734395 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.734457 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.734768 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:46.734770 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:46.734817 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 07:11:46.734893 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 07:11:46.735007 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 07:11:46.735112 706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.727040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37190 (local address 127.9.94.60:43475)
0808 07:11:46.727087 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.727089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.727138 (+ 49us) server_negotiation.cc:407] Connection header received
0808 07:11:46.727232 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.727233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.727243 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.727303 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.727725 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.728461 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.729647 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.729955 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.730024 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.732424 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:46.732425 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:46.732426 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:46.732439 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:46.733904 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.734267 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.734268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.734268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.734325 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.734531 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.734532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.734532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.734685 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:46.734765 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:46.734931 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 07:11:46.735010 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:11:46.737012 622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957: Bootstrap starting.
I20260808 07:11:46.737792 622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:46.738094 622 log.cc:824] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:46.738946 622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957: No bootstrap required, opened a new log
I20260808 07:11:46.740423 622 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } }
I20260808 07:11:46.740569 622 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e7f90432734ccf9d1d8a13f1a68957, State: Initialized, Role: FOLLOWER
I20260808 07:11:46.740681 622 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } }
I20260808 07:11:46.741055 622 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:46.741070 725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } } }
I20260808 07:11:46.741247 725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:11:46.742960 737 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:11:46.743073 737 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:11:46.745754 540 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } attempt: 3
I20260808 07:11:46.743283 547 master_runner.cc:186] Error getting master registration for 127.9.94.62:38835: OK, instance_id { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" instance_seqno: 1786173106295904 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:11:46.746487 547 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 08 07:11:46 dist-test-slave-77v9 krb5kdc[453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173106, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for kudu/127.9.94.60@KRBTEST.COM
I20260808 07:11:46.753955 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.746094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:43475 (local address 127.0.0.1:37202)
0808 07:11:46.746153 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:46.746164 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:46.746215 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:46.746407 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:46.746408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:46.746634 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:46.746681 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.746683 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.747595 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.747597 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.748108 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:46.748109 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.748713 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.748714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:46.748792 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.749336 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:46.749342 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:46.750794 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:46.752703 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.752704 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.752704 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.752957 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.753185 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:46.753186 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:46.753186 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:46.753246 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:46.753601 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:46.753602 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:46.753670 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 07:11:46.753739 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 07:11:46.753849 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 07:11:46.753955 706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.746166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37202 (local address 127.9.94.60:43475)
0808 07:11:46.746209 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.746211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.746223 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:11:46.746293 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.746295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.746308 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.746356 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.746766 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.747516 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.748194 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.748614 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.748702 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.750877 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:46.750878 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:46.750879 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:46.750887 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:46.752618 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.753051 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.753052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.753053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.753114 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.753339 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.753340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.753340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.753515 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:46.753592 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:46.753768 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 07:11:46.753854 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:11:46.756273 540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f: Bootstrap starting.
I20260808 07:11:46.757167 540 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:46.757503 540 log.cc:824] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:46.758294 540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f: No bootstrap required, opened a new log
I20260808 07:11:46.759471 540 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } }
I20260808 07:11:46.759615 540 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4763db6937bf44b4b72a9034bc712c3f, State: Initialized, Role: FOLLOWER
I20260808 07:11:46.759704 540 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } }
I20260808 07:11:46.759982 740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } } }
I20260808 07:11:46.760051 540 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:46.760105 512 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 07:11:46.760200 512 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:46.761152 512 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } }
I20260808 07:11:46.761444 512 leader_election.cc:288] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [CANDIDATE]: Term 1 election: Requested vote from peers 27e7f90432734ccf9d1d8a13f1a68957 (127.9.94.61:37945), aea09c802ee04742a5f827337d9ca751 (127.9.94.60:43475)
I20260808 07:11:46.761992 594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4763db6937bf44b4b72a9034bc712c3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "27e7f90432734ccf9d1d8a13f1a68957"
I20260808 07:11:46.762205 594 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:46.763300 594 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4763db6937bf44b4b72a9034bc712c3f in term 1.
I20260808 07:11:46.765185 486 leader_election.cc:302] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e7f90432734ccf9d1d8a13f1a68957, 4763db6937bf44b4b72a9034bc712c3f; no voters:
I20260808 07:11:46.765698 674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4763db6937bf44b4b72a9034bc712c3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "aea09c802ee04742a5f827337d9ca751"
I20260808 07:11:46.765858 674 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:46.766855 674 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4763db6937bf44b4b72a9034bc712c3f in term 1.
I20260808 07:11:46.768939 758 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:46.769104 466 master_runner.cc:263] No leader master found from master 4763db6937bf44b4b72a9034bc712c3f
I20260808 07:11:46.769166 466 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:11:46.761849 740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:11:46.762668 752 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:11:46.769276 752 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:11:46.769124 758 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [term 1 LEADER]: Becoming Leader. State: Replica: 4763db6937bf44b4b72a9034bc712c3f, State: Running, Role: LEADER
I20260808 07:11:46.777494 758 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } }
I20260808 07:11:46.778282 740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4763db6937bf44b4b72a9034bc712c3f. Latest consensus state: current_term: 1 leader_uuid: "4763db6937bf44b4b72a9034bc712c3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } } }
I20260808 07:11:46.778394 740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:46.790578 706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.770143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37216 (local address 127.9.94.60:43475)
0808 07:11:46.770181 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.770184 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.777185 (+ 7001us) server_negotiation.cc:407] Connection header received
0808 07:11:46.777274 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.777275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.777289 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.777351 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.783050 (+ 5699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.783842 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.785019 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.785324 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.785370 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.787128 (+ 1758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:46.787130 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:46.787131 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:46.787139 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:46.789088 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.789556 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.789557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.789557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.789620 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.789877 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.789878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.789879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.790040 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:46.790132 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:46.790360 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 07:11:46.790448 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 07:11:46.793740 489 tablet.cc:2369] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:11:46.794510 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.770001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42076 (local address 127.9.94.62:38835)
0808 07:11:46.770043 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.770044 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.777393 (+ 7349us) server_negotiation.cc:407] Connection header received
0808 07:11:46.777515 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.777517 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.777529 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.777579 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.780905 (+ 3326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.781654 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.783379 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.783715 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.783763 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.788228 (+ 4465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:46.788229 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:46.788230 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:46.788240 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:46.790113 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.790549 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.790551 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.790551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.790614 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.793142 (+ 2528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.793143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.793144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.793387 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:46.793530 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:46.794305 (+ 775us) server_negotiation.cc:299] Negotiation successful
0808 07:11:46.794402 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:11:46.796154 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:46.769767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48954 (local address 127.9.94.61:37945)
0808 07:11:46.769812 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.769815 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.777087 (+ 7272us) server_negotiation.cc:407] Connection header received
0808 07:11:46.777560 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.777562 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.777575 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.777607 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.779571 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.780347 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.784458 (+ 4111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:46.784803 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:46.784964 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:46.790884 (+ 5920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:46.790886 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:46.790886 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:46.790897 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:46.792663 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.793958 (+ 1295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.793960 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.793960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.794036 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:46.795438 (+ 1402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:46.795440 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:46.795441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:46.795612 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:46.795719 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:46.795951 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 07:11:46.796045 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:11:46.797223 764 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:46.797479 764 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:46.800414 674 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751 [term 1 FOLLOWER]: Refusing update from remote peer 4763db6937bf44b4b72a9034bc712c3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:46.800777 740 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:46.802340 709 sys_catalog.cc:455] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4763db6937bf44b4b72a9034bc712c3f. Latest consensus state: current_term: 1 leader_uuid: "4763db6937bf44b4b72a9034bc712c3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } } }
I20260808 07:11:46.802454 709 sys_catalog.cc:458] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:11:46.803267 594 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957 [term 1 FOLLOWER]: Refusing update from remote peer 4763db6937bf44b4b72a9034bc712c3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:46.804761 740 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:46.806777 725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4763db6937bf44b4b72a9034bc712c3f. Latest consensus state: current_term: 1 leader_uuid: "4763db6937bf44b4b72a9034bc712c3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } } }
I20260808 07:11:46.806915 725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:11:46.808887 725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4763db6937bf44b4b72a9034bc712c3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } } }
I20260808 07:11:46.809020 725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:11:46.808849 768 mvcc.cc:205] Tried to move back new op lower bound from 7316165045452201984 to 7316165045362008064. Current Snapshot: MvccSnapshot[applied={T|T < 7316165045452201984}]
I20260808 07:11:46.809907 759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4763db6937bf44b4b72a9034bc712c3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } } }
I20260808 07:11:46.810125 709 sys_catalog.cc:455] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4763db6937bf44b4b72a9034bc712c3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } } }
I20260808 07:11:46.810230 709 sys_catalog.cc:458] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:11:46.810227 759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:46.810318 759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4763db6937bf44b4b72a9034bc712c3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4763db6937bf44b4b72a9034bc712c3f" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 38835 } } peers { permanent_uuid: "27e7f90432734ccf9d1d8a13f1a68957" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 37945 } } peers { permanent_uuid: "aea09c802ee04742a5f827337d9ca751" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 43475 } } }
I20260808 07:11:46.810364 759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:46.810472 766 mvcc.cc:205] Tried to move back new op lower bound from 7316165045452201984 to 7316165045362008064. Current Snapshot: MvccSnapshot[applied={T|T < 7316165045452201984}]
I20260808 07:11:46.810487 765 mvcc.cc:205] Tried to move back new op lower bound from 7316165045452201984 to 7316165045362008064. Current Snapshot: MvccSnapshot[applied={T|T < 7316165045452201984}]
I20260808 07:11:46.812978 764 catalog_manager.cc:1347] Generated new cluster ID: 98c05f0872844a3c88e1897d27008c01
I20260808 07:11:46.813052 764 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:46.830307 764 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:46.831453 764 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:46.847333 764 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4763db6937bf44b4b72a9034bc712c3f: Generated new TSK 0
I20260808 07:11:46.847756 764 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:11:46.874236 626 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:46.872051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48960 (local address 127.9.94.61:37945)
0808 07:11:46.872103 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.872106 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.873440 (+ 1334us) server_negotiation.cc:407] Connection header received
0808 07:11:46.873568 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.873570 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.873584 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.873619 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.874151 (+ 532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48960: BlockingRecv error: recv got EOF from 127.0.0.1:48960 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260808 07:11:46.875113 706 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:46.872514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37226 (local address 127.9.94.60:43475)
0808 07:11:46.872560 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.872562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.874510 (+ 1948us) server_negotiation.cc:407] Connection header received
0808 07:11:46.874624 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.874625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.874637 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.874670 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.875044 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37226: BlockingRecv error: recv got EOF from 127.0.0.1:37226 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 07:11:46.876058 543 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:46.872892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42078 (local address 127.9.94.62:38835)
0808 07:11:46.872939 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.872941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.875399 (+ 2458us) server_negotiation.cc:407] Connection header received
0808 07:11:46.875505 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.875507 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.875518 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.875550 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.875993 (+ 443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42078: BlockingRecv error: recv got EOF from 127.0.0.1:42078 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 07:11:46.878348 626 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:46.877592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48966 (local address 127.9.94.61:37945)
0808 07:11:46.877634 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.877635 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.877848 (+ 213us) server_negotiation.cc:407] Connection header received
0808 07:11:46.877953 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.877954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.877974 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.878004 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.878298 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48966: BlockingRecv error: recv got EOF from 127.0.0.1:48966 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 07:11:46.881481 626 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:46.880626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48976 (local address 127.9.94.61:37945)
0808 07:11:46.880663 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.880665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.880964 (+ 299us) server_negotiation.cc:407] Connection header received
0808 07:11:46.881056 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.881057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.881068 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.881096 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.881427 (+ 331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48976: BlockingRecv error: recv got EOF from 127.0.0.1:48976 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 07:11:46.886678 626 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:46.885761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48978 (local address 127.9.94.61:37945)
0808 07:11:46.885805 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.885807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.886085 (+ 278us) server_negotiation.cc:407] Connection header received
0808 07:11:46.886192 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.886193 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.886205 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.886235 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.886625 (+ 390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48978: BlockingRecv error: recv got EOF from 127.0.0.1:48978 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 07:11:46.892735 626 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:46.891873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48992 (local address 127.9.94.61:37945)
0808 07:11:46.891911 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.891913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.892167 (+ 254us) server_negotiation.cc:407] Connection header received
0808 07:11:46.892265 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.892266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.892277 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.892307 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.892679 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48992: BlockingRecv error: recv got EOF from 127.0.0.1:48992 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 07:11:46.903429 626 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:46.902309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49004 (local address 127.9.94.61:37945)
0808 07:11:46.902362 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.902365 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.902707 (+ 342us) server_negotiation.cc:407] Connection header received
0808 07:11:46.902850 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.902852 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.902865 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.902900 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.903361 (+ 461us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49004: BlockingRecv error: recv got EOF from 127.0.0.1:49004 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 07:11:46.922627 626 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:46.921475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49012 (local address 127.9.94.61:37945)
0808 07:11:46.921527 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.921529 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.921908 (+ 379us) server_negotiation.cc:407] Connection header received
0808 07:11:46.922033 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.922034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.922048 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.922084 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.922558 (+ 474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49012: BlockingRecv error: recv got EOF from 127.0.0.1:49012 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 07:11:46.957490 626 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:46.956403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49022 (local address 127.9.94.61:37945)
0808 07:11:46.956497 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:46.956500 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:46.956644 (+ 144us) server_negotiation.cc:407] Connection header received
0808 07:11:46.956711 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:46.956713 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:46.956729 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:46.956901 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:46.957424 (+ 523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49022: BlockingRecv error: recv got EOF from 127.0.0.1:49022 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 07:11:47.023993 626 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:47.023075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49034 (local address 127.9.94.61:37945)
0808 07:11:47.023269 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:47.023272 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:47.023382 (+ 110us) server_negotiation.cc:407] Connection header received
0808 07:11:47.023474 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:47.023475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:47.023488 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:47.023558 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:47.023943 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49034: BlockingRecv error: recv got EOF from 127.0.0.1:49034 (error 108)
Metrics: {"server-negotiator.queue_time_us":155}
W20260808 07:11:47.154592 626 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:47.153702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49048 (local address 127.9.94.61:37945)
0808 07:11:47.153769 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:47.153771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:47.153983 (+ 212us) server_negotiation.cc:407] Connection header received
0808 07:11:47.154057 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:47.154058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:47.154076 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:47.154130 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:47.154509 (+ 379us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49048: BlockingRecv error: recv got EOF from 127.0.0.1:49048 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 07:11:47.412789 626 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:47.412032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49054 (local address 127.9.94.61:37945)
0808 07:11:47.412107 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:47.412109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:47.412141 (+ 32us) server_negotiation.cc:407] Connection header received
0808 07:11:47.412181 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:47.412182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:47.412193 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:47.412263 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:47.412692 (+ 429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49054: BlockingRecv error: recv got EOF from 127.0.0.1:49054 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 07:11:47.717389 721 catalog_manager.cc:1259] Loaded cluster ID: 98c05f0872844a3c88e1897d27008c01
I20260808 07:11:47.717665 721 catalog_manager.cc:1552] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751: loading cluster ID for follower catalog manager: success
I20260808 07:11:47.718689 721 catalog_manager.cc:1574] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751: acquiring CA information for follower catalog manager: success
I20260808 07:11:47.719020 721 catalog_manager.cc:1602] T 00000000000000000000000000000000 P aea09c802ee04742a5f827337d9ca751: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:11:47.743638 737 catalog_manager.cc:1259] Loaded cluster ID: 98c05f0872844a3c88e1897d27008c01
I20260808 07:11:47.743743 737 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957: loading cluster ID for follower catalog manager: success
I20260808 07:11:47.744719 737 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957: acquiring CA information for follower catalog manager: success
I20260808 07:11:47.745118 737 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 27e7f90432734ccf9d1d8a13f1a68957: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:11:47.929199 847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:47.926362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49062 (local address 127.9.94.61:37945)
0808 07:11:47.926494 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:47.926496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:47.926505 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:11:47.926532 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:47.926533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:47.926588 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:47.926671 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:47.926870 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:47.927421 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:47.928252 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:47.928477 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:47.928549 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:47.928699 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:47.928909 (+ 210us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:47.928986 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:47.929101 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 07:11:47.929124 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":80,"threads_started":1}
I20260808 07:11:47.934165 853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:47.931385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37236 (local address 127.9.94.60:43475)
0808 07:11:47.931506 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:47.931508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:47.931516 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:11:47.931554 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:47.931555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:47.931588 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:47.931675 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:47.931847 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:47.932404 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:47.933241 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:47.933437 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:47.933505 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:47.933715 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:47.933833 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:47.934016 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:47.934064 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 07:11:47.934089 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":73,"threads_started":1}
I20260808 07:11:47.939182 853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:47.936352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37252 (local address 127.9.94.60:43475)
0808 07:11:47.936395 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:47.936397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:47.936641 (+ 244us) server_negotiation.cc:407] Connection header received
0808 07:11:47.936669 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:47.936670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:47.936681 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:47.936735 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:47.936908 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:47.937436 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:47.938351 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:47.938685 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:47.938757 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:47.938908 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:47.938948 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:47.939009 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:47.939078 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 07:11:47.939100 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:11:47.939529 847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:47.936291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49074 (local address 127.9.94.61:37945)
0808 07:11:47.936338 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:47.936341 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:47.936611 (+ 270us) server_negotiation.cc:407] Connection header received
0808 07:11:47.936680 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:47.936682 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:47.936694 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:47.936745 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:47.936983 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:47.937842 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:47.938663 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:47.938972 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:47.939048 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:47.939232 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:47.939270 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:47.939313 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:47.939426 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 07:11:47.939450 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:11:47.939999 862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:47.936508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42084 (local address 127.9.94.62:38835)
0808 07:11:47.936760 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:47.936762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:47.936770 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:11:47.936838 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:47.936839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:47.936913 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:47.936998 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:47.937081 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:47.937922 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:47.938968 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:47.939304 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:47.939389 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:47.939627 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:47.939753 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:47.939830 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:47.939881 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 07:11:47.939906 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":87,"threads_started":1}
I20260808 07:11:47.946100 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 466
I20260808 07:11:47.954579 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 547
I20260808 07:11:47.961100 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 629
2026-08-08T07:11:47Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3128 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:11:48 dist-test-slave-77v9 krb5kdc[865](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:11:48 dist-test-slave-77v9 krb5kdc[865](info): set up 2 sockets
Aug 08 07:11:48 dist-test-slave-77v9 krb5kdc[865](info): commencing operation
krb5kdc: starting...
W20260808 07:11:49.111922 9592 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/test-user.keytab.
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:11:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:11:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.94.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
Entry for principal kudu/127.9.94.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab.
I20260808 07:11:49.261485 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36699
--webserver_interface=127.9.94.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:44085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:36699,127.9.94.61:35337,127.9.94.60:39061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:11:49.362358 878 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:11:49.362641 878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:49.362664 878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:49.362691 878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:49.364051 878 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:49.364099 878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:49.364114 878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:49.364130 878 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:49.364143 878 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:49.366045 878 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:44085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:36699,127.9.94.61:35337,127.9.94.60:39061
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.62.keytab
--principal=kudu/127.9.94.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.62:36699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.94.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:49.366382 878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:49.366683 878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:49.373262 883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:49.373538 878 server_base.cc:1034] running on GCE node
W20260808 07:11:49.373236 884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:49.373294 886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:49.373951 878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:49.374437 878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:49.375617 878 hybrid_clock.cc:648] HybridClock initialized: now 1786173109375584 us; error 53 us; skew 500 ppm
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:49.379163 878 init.cc:377] Logged in from keytab as kudu/127.9.94.62@KRBTEST.COM (short username kudu)
I20260808 07:11:49.379891 878 webserver.cc:460] Webserver started at http://127.9.94.62:45033/ using document root <none> and password file <none>
I20260808 07:11:49.380419 878 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:49.380519 878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:49.380895 878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:49.382326 878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/data/instance:
uuid: "9f4593edeac8425e867d1bd877b7de89"
format_stamp: "Formatted at 2026-08-08 07:11:49 on dist-test-slave-77v9"
server_key: "77eb04e223cba34d1ce0288644c9bb0b"
server_key_iv: "348a1196ebe6410bc09361636a627d0a"
server_key_version: "encryptionkey@0"
I20260808 07:11:49.383159 878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/wal/instance:
uuid: "9f4593edeac8425e867d1bd877b7de89"
format_stamp: "Formatted at 2026-08-08 07:11:49 on dist-test-slave-77v9"
server_key: "77eb04e223cba34d1ce0288644c9bb0b"
server_key_iv: "348a1196ebe6410bc09361636a627d0a"
server_key_version: "encryptionkey@0"
I20260808 07:11:49.385268 878 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260808 07:11:49.386322 894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:49.386591 878 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:11:49.386718 878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/wal
uuid: "9f4593edeac8425e867d1bd877b7de89"
format_stamp: "Formatted at 2026-08-08 07:11:49 on dist-test-slave-77v9"
server_key: "77eb04e223cba34d1ce0288644c9bb0b"
server_key_iv: "348a1196ebe6410bc09361636a627d0a"
server_key_version: "encryptionkey@0"
I20260808 07:11:49.386816 878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:49.412883 878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:49.416390 878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:49.416613 878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:49.422084 878 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.62:36699
I20260808 07:11:49.422123 949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.62:36699 every 8 connection(s)
I20260808 07:11:49.422551 878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/data/info.pb
I20260808 07:11:49.423588 951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:49.425215 951 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:11:49.429787 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 878
I20260808 07:11:49.429934 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-0/wal/instance
I20260808 07:11:49.430154 9592 external_mini_cluster.cc:1428] Setting key 5dc12ec809e1896736ca02ac6ee39121
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:49.438763 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.425957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36699 (local address 127.0.0.1:37242)
0808 07:11:49.426180 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.426243 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:49.426832 (+ 589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:49.427154 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:49.427156 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:49.427478 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:49.427642 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.427647 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.428848 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.428850 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.429736 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.429740 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.430847 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.430849 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.430957 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.431942 (+ 985us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:49.431954 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:49.434289 (+ 2335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:49.436644 (+ 2355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.436651 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.436654 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.437112 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.437437 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.437438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.437438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.437533 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.438091 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:49.438097 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:49.438169 (+ 72us) client_negotiation.cc:769] Sending connection context
0808 07:11:49.438275 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 07:11:49.438553 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":112,"thread_start_us":72,"threads_started":1}
I20260808 07:11:49.438766 954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.426114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37242 (local address 127.9.94.62:36699)
0808 07:11:49.426244 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:49.426254 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:49.426418 (+ 164us) server_negotiation.cc:407] Connection header received
0808 07:11:49.427023 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:49.427025 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:49.427044 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:49.427147 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:49.427752 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.428690 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.429849 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.430697 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.430882 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.434414 (+ 3532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:49.434422 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:49.434423 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:49.434430 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:49.436503 (+ 2073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.437241 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.437244 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.437245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.437359 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.437599 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.437600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.437601 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.437998 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:49.438103 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:49.438317 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 07:11:49.438480 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":42,"threads_started":1}
I20260808 07:11:49.439668 951 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:11:49.440099 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.439962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:35337 (local address 127.0.0.1:35306)
0808 07:11:49.440017 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.440068 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:35337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 07:11:49.440308 897 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.94.61:35337: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.9.94.61@KRBTEST.COM; defaulting to no policy
I20260808 07:11:49.440922 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.440726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:35337 (local address 127.0.0.1:35314)
0808 07:11:49.440769 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.440815 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:35337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 07:11:49.441069 951 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.61:35337: Network error: Client connection negotiation failed: client connection to 127.9.94.61:35337: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.61.keytab.
Entry for principal kudu/127.9.94.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.61.keytab.
I20260808 07:11:49.466610 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.61:35337
--webserver_interface=127.9.94.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.61.keytab
--principal=kudu/127.9.94.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:44085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:36699,127.9.94.61:35337,127.9.94.60:39061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:11:49.490345 951 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } attempt: 1
I20260808 07:11:49.491205 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.490987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:35337 (local address 127.0.0.1:35318)
0808 07:11:49.491092 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.491154 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:35337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 07:11:49.491699 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.491587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:35337 (local address 127.0.0.1:35326)
0808 07:11:49.491634 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.491670 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:35337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 07:11:49.491843 951 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.61:35337: Network error: Client connection negotiation failed: client connection to 127.9.94.61:35337: connect: Connection refused (error 111)
W20260808 07:11:49.559544 958 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:11:49.559808 958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:49.559827 958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:49.559849 958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 07:11:49.560104 951 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } attempt: 2
I20260808 07:11:49.560611 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.560459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:35337 (local address 127.0.0.1:35340)
0808 07:11:49.560528 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.560576 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:35337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 07:11:49.561106 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.561005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:35337 (local address 127.0.0.1:35352)
0808 07:11:49.561050 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.561082 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.61:35337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 07:11:49.561299 951 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.61:35337: Network error: Client connection negotiation failed: client connection to 127.9.94.61:35337: connect: Connection refused (error 111)
W20260808 07:11:49.561642 958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:49.561691 958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:49.561707 958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:49.561719 958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:49.561733 958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:49.563374 958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:44085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:36699,127.9.94.61:35337,127.9.94.60:39061
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.61.keytab
--principal=kudu/127.9.94.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.61:35337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.94.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:49.563647 958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:49.563941 958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:49.569738 965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:49.569754 967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:49.569743 964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:49.570124 958 server_base.cc:1034] running on GCE node
I20260808 07:11:49.570408 958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:49.570734 958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:49.571914 958 hybrid_clock.cc:648] HybridClock initialized: now 1786173109571879 us; error 56 us; skew 500 ppm
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:49.575136 958 init.cc:377] Logged in from keytab as kudu/127.9.94.61@KRBTEST.COM (short username kudu)
I20260808 07:11:49.575654 958 webserver.cc:460] Webserver started at http://127.9.94.61:44243/ using document root <none> and password file <none>
I20260808 07:11:49.575917 958 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:49.575991 958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:49.576151 958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:49.577426 958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/data/instance:
uuid: "a44174af183342099f1d50cb5f8b1373"
format_stamp: "Formatted at 2026-08-08 07:11:49 on dist-test-slave-77v9"
server_key: "481605239d2fa0e6631f9000c8d1af62"
server_key_iv: "5c3f74ec2480a079b66d1840715a9532"
server_key_version: "encryptionkey@0"
I20260808 07:11:49.577854 958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/wal/instance:
uuid: "a44174af183342099f1d50cb5f8b1373"
format_stamp: "Formatted at 2026-08-08 07:11:49 on dist-test-slave-77v9"
server_key: "481605239d2fa0e6631f9000c8d1af62"
server_key_iv: "5c3f74ec2480a079b66d1840715a9532"
server_key_version: "encryptionkey@0"
I20260808 07:11:49.579348 958 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:11:49.580260 975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:49.580452 958 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:49.580560 958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/wal
uuid: "a44174af183342099f1d50cb5f8b1373"
format_stamp: "Formatted at 2026-08-08 07:11:49 on dist-test-slave-77v9"
server_key: "481605239d2fa0e6631f9000c8d1af62"
server_key_iv: "5c3f74ec2480a079b66d1840715a9532"
server_key_version: "encryptionkey@0"
I20260808 07:11:49.580647 958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:49.592366 958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:49.595469 958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:49.595685 958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:49.600852 958 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.61:35337
I20260808 07:11:49.601065 1031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.61:35337 every 8 connection(s)
I20260808 07:11:49.601361 958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/data/info.pb
I20260808 07:11:49.602415 1032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:49.603299 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 958
I20260808 07:11:49.603444 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-1/wal/instance
I20260808 07:11:49.603689 9592 external_mini_cluster.cc:1428] Setting key 623c2f09b7058acc4935ba2ae2fb8548
I20260808 07:11:49.604995 1032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.61@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.94.60@KRBTEST.COM; defaulting to no policy
I20260808 07:11:49.616050 954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.606129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37254 (local address 127.9.94.62:36699)
0808 07:11:49.606214 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:49.606217 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:49.606455 (+ 238us) server_negotiation.cc:407] Connection header received
0808 07:11:49.607049 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:49.607050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:49.607066 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:49.607134 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:49.607872 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.608479 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.609694 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.609935 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.610020 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.612719 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:49.612721 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:49.612721 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:49.612765 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:49.614451 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.614934 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.614935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.614935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.615003 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.615290 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.615291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.615292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.615429 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:49.615508 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:49.615834 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 07:11:49.615932 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 07:11:49.616278 1035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.606067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36699 (local address 127.0.0.1:37254)
0808 07:11:49.606303 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.606346 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:49.606928 (+ 582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:49.607210 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:49.607214 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:49.607534 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:49.607761 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.607766 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.608593 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.608594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.609581 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.609584 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.610044 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.610045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.610187 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.610927 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:49.610936 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:49.612599 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:49.614569 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.614578 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.614581 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.614845 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.615085 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.615085 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.615086 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.615211 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.615514 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:49.615522 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:49.615682 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 07:11:49.615798 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 07:11:49.615988 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":121,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.94.60@KRBTEST.COM" created.
I20260808 07:11:49.617118 1032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.61@KRBTEST.COM for kudu/127.9.94.61@KRBTEST.COM
I20260808 07:11:49.627910 1035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.617691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:35337 (local address 127.0.0.1:35356)
0808 07:11:49.617764 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.617780 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:49.617841 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:49.618313 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:49.618314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:49.618463 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:49.618525 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.618527 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.619592 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.619593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.620461 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.620465 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.621464 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.621465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.621575 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.622083 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:49.622089 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:49.624155 (+ 2066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:49.626770 (+ 2615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.626772 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.626773 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.626962 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.627188 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.627189 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.627189 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.627249 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.627548 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:49.627549 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:49.627589 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 07:11:49.627655 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 07:11:49.627772 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 07:11:49.628024 1036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.617776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35356 (local address 127.9.94.61:35337)
0808 07:11:49.618071 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:49.618077 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:49.618111 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:11:49.618143 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:49.618145 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:49.618165 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:49.618283 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:49.618615 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.619494 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.620713 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.621322 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.621448 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.624302 (+ 2854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:49.624326 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:49.624326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:49.624334 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:49.626636 (+ 2302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.627047 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.627051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.627051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.627111 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.627312 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.627313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.627314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.627478 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:49.627572 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:49.627695 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 07:11:49.627855 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":249,"thread_start_us":176,"threads_started":1}
I20260808 07:11:49.628897 1032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:11:49.629335 1035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.629212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:39061 (local address 127.0.0.1:52514)
0808 07:11:49.629267 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.629316 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 07:11:49.629529 979 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
I20260808 07:11:49.630287 1035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.630189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:39061 (local address 127.0.0.1:52530)
0808 07:11:49.630238 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.630265 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 07:11:49.630488 1032 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:39061: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.94.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.60.keytab.
Entry for principal kudu/127.9.94.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.60.keytab.
I20260808 07:11:49.637418 9592 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskfmG05D/build/release/bin/kudu
/tmp/dist-test-taskfmG05D/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.60:39061
--webserver_interface=127.9.94.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.60.keytab
--principal=kudu/127.9.94.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.94.20:44085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.94.62:36699,127.9.94.61:35337,127.9.94.60:39061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:11:49.652504 951 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } attempt: 3
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for kudu/127.9.94.61@KRBTEST.COM
I20260808 07:11:49.660915 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.652965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:35337 (local address 127.0.0.1:35362)
0808 07:11:49.653043 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.653057 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:49.653105 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:49.653288 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:49.653289 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:49.653460 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:49.653526 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.653528 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.654351 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.654352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.654950 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.654952 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.655372 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.655373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.655482 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.655991 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:49.655996 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:49.657552 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:49.659375 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.659376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.659377 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.659637 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.659912 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.660069 (+ 157us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.660070 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.660163 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.660514 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:49.660515 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:49.660576 (+ 61us) client_negotiation.cc:769] Sending connection context
0808 07:11:49.660665 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 07:11:49.660774 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 07:11:49.661070 1036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.653089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35362 (local address 127.9.94.61:35337)
0808 07:11:49.653163 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:49.653165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:49.653175 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:11:49.653209 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:49.653210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:49.653220 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:49.653281 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:49.653606 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.654235 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.655048 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.655291 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.655374 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.657675 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:49.657676 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:49.657677 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:49.657683 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:49.659282 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.659747 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.659748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.659749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.659817 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.660288 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.660289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.660289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.660432 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:49.660510 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:49.660713 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 07:11:49.660803 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 07:11:49.661471 951 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:11:49.661856 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.661741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:39061 (local address 127.0.0.1:52544)
0808 07:11:49.661795 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.661832 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 07:11:49.662335 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.662223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:39061 (local address 127.0.0.1:52560)
0808 07:11:49.662290 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.662317 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 07:11:49.662453 951 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:39061: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
I20260808 07:11:49.679766 1032 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } attempt: 1
I20260808 07:11:49.680380 1035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.680201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:39061 (local address 127.0.0.1:52570)
0808 07:11:49.680280 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.680339 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 07:11:49.680938 1035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.680732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:39061 (local address 127.0.0.1:52572)
0808 07:11:49.680867 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.680913 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260808 07:11:49.681174 1032 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:39061: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
I20260808 07:11:49.693598 951 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } attempt: 1
I20260808 07:11:49.694238 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.694016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:39061 (local address 127.0.0.1:52578)
0808 07:11:49.694139 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.694194 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260808 07:11:49.694701 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.694603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:39061 (local address 127.0.0.1:52588)
0808 07:11:49.694647 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.694679 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 07:11:49.694804 951 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:39061: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
W20260808 07:11:49.733630 1039 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:11:49.733870 1039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:11:49.733887 1039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:11:49.733907 1039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:11:49.735050 1039 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:11:49.735098 1039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:11:49.735112 1039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:11:49.735124 1039 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:11:49.735136 1039 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:11:49.736639 1039 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.94.20:44085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.94.62:36699,127.9.94.61:35337,127.9.94.60:39061
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/krb5kdc/kudu_127.9.94.60.keytab
--principal=kudu/127.9.94.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.94.60:39061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.94.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:11:30 UTC on ccycloud.quasar-iqclcm.root.comops.site
build id 4574014
I20260808 07:11:49.736949 1039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:11:49.737179 1039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:11:49.742314 1048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:49.742265 1045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:11:49.742272 1046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:11:49.742720 1039 server_base.cc:1034] running on GCE node
I20260808 07:11:49.743054 1039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:11:49.743381 1039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:11:49.744554 1039 hybrid_clock.cc:648] HybridClock initialized: now 1786173109744514 us; error 53 us; skew 500 ppm
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:11:49.747480 1039 init.cc:377] Logged in from keytab as kudu/127.9.94.60@KRBTEST.COM (short username kudu)
I20260808 07:11:49.747961 1039 webserver.cc:460] Webserver started at http://127.9.94.60:41695/ using document root <none> and password file <none>
I20260808 07:11:49.748211 1039 fs_manager.cc:359] Metadata directory not provided
I20260808 07:11:49.748292 1039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:11:49.748448 1039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:11:49.749357 1032 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } attempt: 2
I20260808 07:11:49.749835 1035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.749678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:39061 (local address 127.0.0.1:52602)
0808 07:11:49.749759 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.749797 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 07:11:49.749725 1039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/data/instance:
uuid: "c956c2dae4554517b578707d2c490646"
format_stamp: "Formatted at 2026-08-08 07:11:49 on dist-test-slave-77v9"
server_key: "2efdcf8e9e84bc94c369e2d4a63ad044"
server_key_iv: "d71fb10fef7b6d36244a6d5a3a9d6475"
server_key_version: "encryptionkey@0"
I20260808 07:11:49.750164 1039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/wal/instance:
uuid: "c956c2dae4554517b578707d2c490646"
format_stamp: "Formatted at 2026-08-08 07:11:49 on dist-test-slave-77v9"
server_key: "2efdcf8e9e84bc94c369e2d4a63ad044"
server_key_iv: "d71fb10fef7b6d36244a6d5a3a9d6475"
server_key_version: "encryptionkey@0"
I20260808 07:11:49.750221 1035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.750130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:39061 (local address 127.0.0.1:52608)
0808 07:11:49.750175 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.750202 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 07:11:49.750316 1032 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:39061: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
I20260808 07:11:49.751631 1039 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:11:49.752696 1056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:11:49.752951 1039 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:11:49.753060 1039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/data,/tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/wal
uuid: "c956c2dae4554517b578707d2c490646"
format_stamp: "Formatted at 2026-08-08 07:11:49 on dist-test-slave-77v9"
server_key: "2efdcf8e9e84bc94c369e2d4a63ad044"
server_key_iv: "d71fb10fef7b6d36244a6d5a3a9d6475"
server_key_version: "encryptionkey@0"
I20260808 07:11:49.753512 1039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:11:49.769961 951 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } attempt: 2
I20260808 07:11:49.770467 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.770319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:39061 (local address 127.0.0.1:52612)
0808 07:11:49.770384 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.770422 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 07:11:49.770813 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.770719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:39061 (local address 127.0.0.1:52628)
0808 07:11:49.770764 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.770789 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 07:11:49.770915 951 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.94.60:39061: Network error: Client connection negotiation failed: client connection to 127.9.94.60:39061: connect: Connection refused (error 111)
I20260808 07:11:49.779742 1039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:11:49.782444 1039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:11:49.782644 1039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:11:49.788440 1039 rpc_server.cc:307] RPC server started. Bound to: 127.9.94.60:39061
I20260808 07:11:49.788538 1117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.94.60:39061 every 8 connection(s)
I20260808 07:11:49.788961 1039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/data/info.pb
I20260808 07:11:49.790217 1118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:11:49.792135 1118 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:11:49.794780 9592 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskfmG05D/build/release/bin/kudu as pid 1039
I20260808 07:11:49.794945 9592 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskfmG05D/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172813832116-9592-0/minicluster-data/master-2/wal/instance
I20260808 07:11:49.795198 9592 external_mini_cluster.cc:1428] Setting key 04d7e5a4b4ae96bee943c8fe8c10fa6e
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.60@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.60@KRBTEST.COM
I20260808 07:11:49.805229 954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.793190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37270 (local address 127.9.94.62:36699)
0808 07:11:49.793270 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:49.793273 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:49.793321 (+ 48us) server_negotiation.cc:407] Connection header received
0808 07:11:49.793870 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:49.793872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:49.793887 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:49.794103 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:49.795209 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.795824 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.797339 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.797544 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.797631 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.800723 (+ 3092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:49.800726 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:49.800726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:49.800738 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:49.802810 (+ 2072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.803612 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.803614 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.803614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.803690 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.804117 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.804119 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.804119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.804311 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:49.804412 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:49.805049 (+ 637us) server_negotiation.cc:299] Negotiation successful
0808 07:11:49.805151 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 07:11:49.805506 1120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.792981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.62:36699 (local address 127.0.0.1:37270)
0808 07:11:49.793168 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.793219 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:49.793728 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:49.794171 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:49.794175 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:49.794496 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:49.794959 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.794967 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.795952 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.795954 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.797168 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.797171 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.797667 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.797668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.797870 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.798612 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:49.798622 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:49.800512 (+ 1890us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:49.802980 (+ 2468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.802998 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.803001 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.803394 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.803798 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.803799 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.803800 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.804010 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.804478 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:49.804490 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:49.804746 (+ 256us) client_negotiation.cc:769] Sending connection context
0808 07:11:49.805001 (+ 255us) client_negotiation.cc:240] Negotiation successful
0808 07:11:49.805212 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":104,"threads_started":1}
I20260808 07:11:49.806257 1118 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:11:49.806948 1122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.795708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52642 (local address 127.9.94.60:39061)
0808 07:11:49.795924 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:49.795929 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:49.795950 (+ 21us) server_negotiation.cc:407] Connection header received
0808 07:11:49.795995 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:49.795998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:49.796028 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:49.796112 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:49.796922 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.798052 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.799100 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.799516 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.799581 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.802729 (+ 3148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:49.802742 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:49.802743 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:49.802752 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:49.805014 (+ 2262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.805478 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.805482 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.805482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.805549 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.805813 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.805814 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.805814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.806079 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:49.806234 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:49.806409 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 07:11:49.806518 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":109,"threads_started":1}
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.60@KRBTEST.COM for kudu/127.9.94.61@KRBTEST.COM
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.62@KRBTEST.COM
I20260808 07:11:49.813814 1036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.806683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35376 (local address 127.9.94.61:35337)
0808 07:11:49.806751 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:49.806753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:49.806761 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:11:49.806793 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:49.806794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:49.806803 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:49.806891 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:49.807187 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.807883 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.808531 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.808762 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.808861 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.811046 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:49.811048 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:49.811048 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:49.811057 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:49.812540 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.812977 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.812979 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.812980 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.813041 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.813298 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.813298 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.813299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.813420 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:49.813488 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:49.813649 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 07:11:49.813714 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 07:11:49.813840 1120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.806595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.61:35337 (local address 127.0.0.1:35376)
0808 07:11:49.806645 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.806657 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:49.806703 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:49.806902 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:49.806904 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:49.807023 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:49.807111 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.807113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.807966 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.807967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.808445 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.808446 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.808874 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.808875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.808948 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.809374 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:49.809379 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:49.810897 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:49.812633 (+ 1736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.812635 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.812635 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.812897 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.813110 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.813110 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.813111 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.813186 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.813491 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:49.813492 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:49.813539 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 07:11:49.813609 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 07:11:49.813717 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 07:11:49.814298 1118 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:11:49.817116 954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.807802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37280 (local address 127.9.94.62:36699)
0808 07:11:49.807851 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:49.807853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:49.807861 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:11:49.807884 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:49.807885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:49.807897 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:49.807956 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:49.808518 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.809080 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.810035 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.810372 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.810441 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.813531 (+ 3090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:49.813533 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:49.813533 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:49.813542 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:49.815586 (+ 2044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.816103 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.816104 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.816105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.816184 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.816441 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.816442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.816442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.816577 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:49.816783 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:49.816903 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 07:11:49.816995 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.60@KRBTEST.COM for kudu/127.9.94.60@KRBTEST.COM
I20260808 07:11:49.823733 1120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.814576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:39061 (local address 127.0.0.1:52652)
0808 07:11:49.814627 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.814638 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:49.814680 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:49.814821 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:49.814822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:49.814990 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:49.815026 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.815027 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.816220 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.816223 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.816999 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.817006 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.817652 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.817654 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.817736 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.818373 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:49.818377 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:49.820179 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:49.822563 (+ 2384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.822564 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.822565 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.822763 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.823003 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.823004 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.823004 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.823066 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.823342 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:49.823343 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:49.823385 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 07:11:49.823483 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 07:11:49.823603 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.94.61@KRBTEST.COM
I20260808 07:11:49.823740 1122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.814640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52652 (local address 127.9.94.60:39061)
0808 07:11:49.814679 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:49.814681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:49.814689 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:11:49.814724 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:49.814724 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:49.814740 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:49.814816 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:49.815101 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.815925 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.817176 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.817573 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.817645 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.820270 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:49.820272 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:49.820272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:49.820280 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:49.822473 (+ 2193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.822863 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.822864 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.822864 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.822934 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.823133 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.823134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.823134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.823251 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:49.823348 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:49.823517 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 07:11:49.823653 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":22}
I20260808 07:11:49.826104 1118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646: Bootstrap starting.
I20260808 07:11:49.827276 1118 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:49.827656 1118 log.cc:824] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:49.827996 1036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.818382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35384 (local address 127.9.94.61:35337)
0808 07:11:49.818472 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:49.818475 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:49.818486 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:11:49.818512 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:49.818513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:49.818525 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:49.818607 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:49.819643 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.820365 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.821480 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.821997 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.822098 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.824684 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:49.824686 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:49.824686 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:49.824695 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:49.826726 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.827113 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.827115 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.827115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.827179 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.827396 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.827397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.827398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.827555 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:49.827717 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:49.827793 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 07:11:49.827885 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 07:11:49.828866 1118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646: No bootstrap required, opened a new log
I20260808 07:11:49.830156 9592 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:11:49.831328 1118 raft_consensus.cc:348] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } }
I20260808 07:11:49.831549 1118 raft_consensus.cc:729] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c956c2dae4554517b578707d2c490646, State: Initialized, Role: FOLLOWER
I20260808 07:11:49.831656 1118 consensus_queue.cc:260] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } }
I20260808 07:11:49.831983 1124 sys_catalog.cc:455] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } } }
I20260808 07:11:49.832042 1118 sys_catalog.cc:564] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:49.832098 1124 sys_catalog.cc:458] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:11:49.831619 922 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "9f4593edeac8425e867d1bd877b7de89"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37280
W20260808 07:11:49.834344 1136 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:11:49.834462 1136 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:11:49.834582 1039 master_runner.cc:186] Error getting master registration for 127.9.94.62:36699: OK, instance_id { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" instance_seqno: 1786173109420396 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:11:49.837913 1039 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:11:49.841472 1032 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } attempt: 3
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.61@KRBTEST.COM for kudu/127.9.94.60@KRBTEST.COM
I20260808 07:11:49.850111 1035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.841850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:39061 (local address 127.0.0.1:52656)
0808 07:11:49.841915 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.841927 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:49.841994 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:49.842154 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:49.842155 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:49.842352 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:49.842397 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.842399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.843151 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.843152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.843729 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.843730 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.844426 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.844427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.844497 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.845117 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:49.845123 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:49.846832 (+ 1709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:49.848988 (+ 2156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.848989 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.848990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.849167 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.849398 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.849398 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.849399 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.849460 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.849778 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:49.849779 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:49.849826 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 07:11:49.849903 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 07:11:49.850009 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 07:11:49.850111 1122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.841927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52656 (local address 127.9.94.60:39061)
0808 07:11:49.841997 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:49.841999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:49.842011 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:11:49.842066 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:49.842067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:49.842079 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:49.842139 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:49.842501 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.843060 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.843828 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.844156 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.844430 (+ 274us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.846952 (+ 2522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:49.846955 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:49.846955 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:49.846963 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:49.848888 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.849244 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.849246 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.849246 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.849304 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.849524 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.849526 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.849526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.849695 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:49.849772 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:49.849927 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 07:11:49.850011 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 07:11:49.852635 1032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373: Bootstrap starting.
I20260808 07:11:49.853528 1032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:49.853904 1032 log.cc:824] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:49.854887 1032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373: No bootstrap required, opened a new log
I20260808 07:11:49.857401 1032 raft_consensus.cc:348] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } }
I20260808 07:11:49.857582 1032 raft_consensus.cc:729] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a44174af183342099f1d50cb5f8b1373, State: Initialized, Role: FOLLOWER
I20260808 07:11:49.857672 1032 consensus_queue.cc:260] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } }
I20260808 07:11:49.858088 1032 sys_catalog.cc:564] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:49.858129 1139 sys_catalog.cc:455] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } } }
I20260808 07:11:49.858342 1139 sys_catalog.cc:458] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:11:49.860656 1152 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:11:49.860749 1152 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:11:49.860738 958 master_runner.cc:186] Error getting master registration for 127.9.94.62:36699: OK, instance_id { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" instance_seqno: 1786173109420396 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:11:49.864037 958 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:11:49.870146 951 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } attempt: 3
Aug 08 07:11:49 dist-test-slave-77v9 krb5kdc[865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173109, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.94.62@KRBTEST.COM for kudu/127.9.94.60@KRBTEST.COM
I20260808 07:11:49.879716 1122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.870722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52664 (local address 127.9.94.60:39061)
0808 07:11:49.870787 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:49.870789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:49.870800 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:11:49.870833 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:49.870842 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:49.870854 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:49.870944 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:49.871325 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.872078 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.873247 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.873543 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.873623 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.876063 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:49.876064 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:49.876065 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:49.876073 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:49.877878 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.878737 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.878744 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.878744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.878818 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.879099 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.879100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.879100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.879257 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:49.879330 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:49.879521 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 07:11:49.879610 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 07:11:49.879738 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.870582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.94.60:39061 (local address 127.0.0.1:52664)
0808 07:11:49.870648 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 07:11:49.870660 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:11:49.870707 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:11:49.870966 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:11:49.870967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:11:49.871184 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:11:49.871243 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.871245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.872179 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.872181 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.873161 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:11:49.873164 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.873632 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.873634 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:11:49.873699 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.874248 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:11:49.874254 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:11:49.875978 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:11:49.878148 (+ 2170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.878151 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.878152 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.878513 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.878903 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:11:49.878904 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:11:49.878905 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:11:49.879016 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:11:49.879334 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:11:49.879336 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:11:49.879397 (+ 61us) client_negotiation.cc:769] Sending connection context
0808 07:11:49.879482 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 07:11:49.879616 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 07:11:49.881976 951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89: Bootstrap starting.
I20260808 07:11:49.882771 951 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89: Neither blocks nor log segments found. Creating new log.
I20260808 07:11:49.883072 951 log.cc:824] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89: Log is configured to *not* fsync() on all Append() calls
I20260808 07:11:49.884044 951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89: No bootstrap required, opened a new log
I20260808 07:11:49.885623 951 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } }
I20260808 07:11:49.885866 951 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4593edeac8425e867d1bd877b7de89, State: Initialized, Role: FOLLOWER
I20260808 07:11:49.886003 951 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } }
I20260808 07:11:49.886512 951 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:11:49.886934 922 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 07:11:49.887030 922 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:49.888002 922 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } }
I20260808 07:11:49.888303 922 leader_election.cc:288] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [CANDIDATE]: Term 1 election: Requested vote from peers a44174af183342099f1d50cb5f8b1373 (127.9.94.61:35337), c956c2dae4554517b578707d2c490646 (127.9.94.60:39061)
I20260808 07:11:49.888883 1004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9f4593edeac8425e867d1bd877b7de89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a44174af183342099f1d50cb5f8b1373"
I20260808 07:11:49.889037 1004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:49.889973 1004 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f4593edeac8425e867d1bd877b7de89 in term 1.
I20260808 07:11:49.889932 1155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } } }
I20260808 07:11:49.890220 1155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:11:49.890235 1087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9f4593edeac8425e867d1bd877b7de89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c956c2dae4554517b578707d2c490646"
I20260808 07:11:49.890355 1087 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:11:49.891264 1087 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f4593edeac8425e867d1bd877b7de89 in term 1.
I20260808 07:11:49.891682 897 leader_election.cc:302] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4593edeac8425e867d1bd877b7de89, c956c2dae4554517b578707d2c490646; no voters:
I20260808 07:11:49.891819 1155 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:11:49.891996 1155 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f4593edeac8425e867d1bd877b7de89, State: Running, Role: LEADER
I20260808 07:11:49.892097 1155 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } }
I20260808 07:11:49.892567 1155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f4593edeac8425e867d1bd877b7de89. Latest consensus state: current_term: 1 leader_uuid: "9f4593edeac8425e867d1bd877b7de89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } } }
I20260808 07:11:49.892644 1155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [sys.catalog]: This master's current role is: LEADER
W20260808 07:11:49.893412 1171 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:11:49.893473 1171 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:11:49.894538 878 master_runner.cc:263] No leader master found from master 9f4593edeac8425e867d1bd877b7de89
I20260808 07:11:49.894587 878 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:11:49.901868 1174 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:11:49.902446 1174 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:11:49.906395 1036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.893812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35394 (local address 127.9.94.61:35337)
0808 07:11:49.893866 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:49.893869 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:49.897039 (+ 3170us) server_negotiation.cc:407] Connection header received
0808 07:11:49.897166 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:49.897167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:49.897180 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:49.897215 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:49.898167 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.899127 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.900432 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.900771 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.900967 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.903021 (+ 2054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:49.903023 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:49.903023 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:49.903032 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:49.904930 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.905386 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.905387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.905388 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.905452 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.905672 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.905673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.905673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.905811 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:49.905907 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:49.906170 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 07:11:49.906285 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:11:49.912878 1122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.894178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52678 (local address 127.9.94.60:39061)
0808 07:11:49.894213 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:49.894215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:49.900975 (+ 6760us) server_negotiation.cc:407] Connection header received
0808 07:11:49.902184 (+ 1209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:49.902186 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:49.902200 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:49.902235 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:49.904187 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.905037 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.906159 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.906516 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.906731 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.909105 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:49.909107 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:49.909108 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:49.909117 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:49.910810 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.911956 (+ 1146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.911957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.911958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.912023 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.912229 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.912230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.912230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.912366 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:49.912437 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:49.912638 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 07:11:49.912720 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:11:49.914003 1087 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646 [term 1 FOLLOWER]: Refusing update from remote peer 9f4593edeac8425e867d1bd877b7de89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:49.914532 1172 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:49.914969 954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:49.894413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37288 (local address 127.9.94.62:36699)
0808 07:11:49.894455 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:49.894457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:49.906916 (+ 12459us) server_negotiation.cc:407] Connection header received
0808 07:11:49.907030 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:49.907031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:49.907043 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:49.907077 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:49.907872 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.908689 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.909759 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:49.910103 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:49.910149 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:49.911733 (+ 1584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:11:49.911735 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:11:49.911736 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:11:49.911744 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:11:49.913591 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.914002 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.914003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.914003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.914063 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:11:49.914260 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:11:49.914261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:11:49.914261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:11:49.914476 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:11:49.914553 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:49.914780 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 07:11:49.914870 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:11:49.916625 1124 sys_catalog.cc:455] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f4593edeac8425e867d1bd877b7de89. Latest consensus state: current_term: 1 leader_uuid: "9f4593edeac8425e867d1bd877b7de89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } } }
I20260808 07:11:49.916723 1124 sys_catalog.cc:458] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:11:49.917548 900 tablet.cc:2369] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:11:49.917999 1004 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373 [term 1 FOLLOWER]: Refusing update from remote peer 9f4593edeac8425e867d1bd877b7de89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:11:49.918387 1172 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:11:49.920463 1139 sys_catalog.cc:455] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f4593edeac8425e867d1bd877b7de89. Latest consensus state: current_term: 1 leader_uuid: "9f4593edeac8425e867d1bd877b7de89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } } }
I20260808 07:11:49.920584 1139 sys_catalog.cc:458] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:11:49.922667 1155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9f4593edeac8425e867d1bd877b7de89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } } }
I20260808 07:11:49.922775 1155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:49.922816 1155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9f4593edeac8425e867d1bd877b7de89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } } }
I20260808 07:11:49.922855 1155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89 [sys.catalog]: This master's current role is: LEADER
I20260808 07:11:49.922922 1124 sys_catalog.cc:455] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9f4593edeac8425e867d1bd877b7de89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } } }
I20260808 07:11:49.923018 1124 sys_catalog.cc:458] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:11:49.923568 1139 sys_catalog.cc:455] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9f4593edeac8425e867d1bd877b7de89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4593edeac8425e867d1bd877b7de89" member_type: VOTER last_known_addr { host: "127.9.94.62" port: 36699 } } peers { permanent_uuid: "a44174af183342099f1d50cb5f8b1373" member_type: VOTER last_known_addr { host: "127.9.94.61" port: 35337 } } peers { permanent_uuid: "c956c2dae4554517b578707d2c490646" member_type: VOTER last_known_addr { host: "127.9.94.60" port: 39061 } } }
I20260808 07:11:49.923659 1139 sys_catalog.cc:458] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:11:49.924054 1181 mvcc.cc:205] Tried to move back new op lower bound from 7316165058197159936 to 7316165058118856704. Current Snapshot: MvccSnapshot[applied={T|T < 7316165058197159936}]
I20260808 07:11:49.924285 1180 mvcc.cc:205] Tried to move back new op lower bound from 7316165058197159936 to 7316165058118856704. Current Snapshot: MvccSnapshot[applied={T|T < 7316165058197159936}]
I20260808 07:11:49.928774 1174 catalog_manager.cc:1347] Generated new cluster ID: c23cc17196c048cfba5a5205617eca41
I20260808 07:11:49.928956 1174 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:11:49.966355 1174 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:11:49.967383 1174 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:11:49.973218 1174 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f4593edeac8425e867d1bd877b7de89: Generated new TSK 0
I20260808 07:11:49.973601 1174 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:11:50.006702 1036 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:50.004527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35396 (local address 127.9.94.61:35337)
0808 07:11:50.004583 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:50.004585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:50.005703 (+ 1118us) server_negotiation.cc:407] Connection header received
0808 07:11:50.005829 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:50.005831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:50.005844 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:50.005969 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:50.006619 (+ 650us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35396: BlockingRecv error: recv got EOF from 127.0.0.1:35396 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260808 07:11:50.007860 1122 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:50.005005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52680 (local address 127.9.94.60:39061)
0808 07:11:50.005048 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:50.005050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:50.007266 (+ 2216us) server_negotiation.cc:407] Connection header received
0808 07:11:50.007380 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:50.007381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:50.007394 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:50.007428 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:50.007792 (+ 364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52680: BlockingRecv error: recv got EOF from 127.0.0.1:52680 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 07:11:50.009420 954 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:50.005507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37304 (local address 127.9.94.62:36699)
0808 07:11:50.005553 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:50.005555 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:50.008319 (+ 2764us) server_negotiation.cc:407] Connection header received
0808 07:11:50.008471 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:50.008483 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:50.008497 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:50.008532 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:50.009315 (+ 783us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37304: BlockingRecv error: recv got EOF from 127.0.0.1:37304 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260808 07:11:50.011919 1036 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:50.011008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35406 (local address 127.9.94.61:35337)
0808 07:11:50.011051 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:50.011054 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:50.011304 (+ 250us) server_negotiation.cc:407] Connection header received
0808 07:11:50.011448 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:50.011449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:50.011471 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:50.011506 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:50.011862 (+ 356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35406: BlockingRecv error: recv got EOF from 127.0.0.1:35406 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 07:11:50.018342 1036 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:50.017333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35420 (local address 127.9.94.61:35337)
0808 07:11:50.017392 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:50.017394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:50.017706 (+ 312us) server_negotiation.cc:407] Connection header received
0808 07:11:50.017821 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:50.017822 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:50.017835 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:50.017871 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:50.018276 (+ 405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35420: BlockingRecv error: recv got EOF from 127.0.0.1:35420 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 07:11:50.023167 1036 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:50.022101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35422 (local address 127.9.94.61:35337)
0808 07:11:50.022146 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:50.022148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:50.022498 (+ 350us) server_negotiation.cc:407] Connection header received
0808 07:11:50.022636 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:50.022638 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:50.022650 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:50.022685 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:50.023105 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35422: BlockingRecv error: recv got EOF from 127.0.0.1:35422 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 07:11:50.029853 1036 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:50.028718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35432 (local address 127.9.94.61:35337)
0808 07:11:50.028766 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:50.028768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:50.029178 (+ 410us) server_negotiation.cc:407] Connection header received
0808 07:11:50.029296 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:50.029297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:50.029310 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:50.029343 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:50.029772 (+ 429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35432: BlockingRecv error: recv got EOF from 127.0.0.1:35432 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 07:11:50.041031 1036 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:50.039913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35438 (local address 127.9.94.61:35337)
0808 07:11:50.039969 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:50.039972 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:50.040301 (+ 329us) server_negotiation.cc:407] Connection header received
0808 07:11:50.040426 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:50.040427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:50.040442 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:50.040478 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:50.040961 (+ 483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35438: BlockingRecv error: recv got EOF from 127.0.0.1:35438 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 07:11:50.060103 1036 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:50.059129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35444 (local address 127.9.94.61:35337)
0808 07:11:50.059182 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:50.059185 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:50.059384 (+ 199us) server_negotiation.cc:407] Connection header received
0808 07:11:50.059484 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:50.059485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:50.059499 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:50.059584 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:50.060034 (+ 450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35444: BlockingRecv error: recv got EOF from 127.0.0.1:35444 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260808 07:11:50.094646 1036 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:50.093465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35456 (local address 127.9.94.61:35337)
0808 07:11:50.093547 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:50.093549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:50.093653 (+ 104us) server_negotiation.cc:407] Connection header received
0808 07:11:50.093734 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:50.093735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:50.093746 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:50.093808 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:50.094565 (+ 757us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35456: BlockingRecv error: recv got EOF from 127.0.0.1:35456 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260808 07:11:50.161582 1036 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:50.160291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35472 (local address 127.9.94.61:35337)
0808 07:11:50.160370 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:50.160372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:50.160472 (+ 100us) server_negotiation.cc:407] Connection header received
0808 07:11:50.160539 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:50.160540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:50.160552 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:50.160614 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:50.161494 (+ 880us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35472: BlockingRecv error: recv got EOF from 127.0.0.1:35472 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260808 07:11:50.292347 1036 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:50.291340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35486 (local address 127.9.94.61:35337)
0808 07:11:50.291432 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:50.291435 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:50.291448 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:11:50.291489 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:50.291490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:50.291505 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:50.291753 (+ 248us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:50.292243 (+ 490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35486: BlockingRecv error: recv got EOF from 127.0.0.1:35486 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260808 07:11:50.550796 1036 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:11:50.550139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35494 (local address 127.9.94.61:35337)
0808 07:11:50.550212 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:50.550214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:50.550225 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:11:50.550260 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:50.550261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:50.550274 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:50.550356 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:11:50.550721 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35494: BlockingRecv error: recv got EOF from 127.0.0.1:35494 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:11:50.835002 1136 catalog_manager.cc:1259] Loaded cluster ID: c23cc17196c048cfba5a5205617eca41
I20260808 07:11:50.835091 1136 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646: loading cluster ID for follower catalog manager: success
I20260808 07:11:50.836009 1136 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646: acquiring CA information for follower catalog manager: success
I20260808 07:11:50.836376 1136 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c956c2dae4554517b578707d2c490646: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:11:50.861416 1152 catalog_manager.cc:1259] Loaded cluster ID: c23cc17196c048cfba5a5205617eca41
I20260808 07:11:50.861514 1152 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373: loading cluster ID for follower catalog manager: success
I20260808 07:11:50.863196 1152 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373: acquiring CA information for follower catalog manager: success
I20260808 07:11:50.863937 1152 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a44174af183342099f1d50cb5f8b1373: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:11:51.067454 1261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:51.064273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35506 (local address 127.9.94.61:35337)
0808 07:11:51.064401 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:51.064403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:51.064439 (+ 36us) server_negotiation.cc:407] Connection header received
0808 07:11:51.064465 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:51.064466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:51.064518 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:51.064587 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:51.064920 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:51.065491 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:51.066318 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:51.066575 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:51.066654 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:51.066931 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:51.067050 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:51.067121 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:51.067267 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 07:11:51.067325 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
I20260808 07:11:51.072626 1267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:51.069951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52686 (local address 127.9.94.60:39061)
0808 07:11:51.070089 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:51.070091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:51.070098 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:11:51.070136 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:51.070137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:51.070175 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:51.070257 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:51.070351 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:51.070944 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:51.071751 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:51.072008 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:51.072077 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:51.072205 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:51.072312 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:51.072471 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:51.072530 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 07:11:51.072552 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":82,"threads_started":1}
I20260808 07:11:51.078019 1267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:51.074820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52692 (local address 127.9.94.60:39061)
0808 07:11:51.074856 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:51.074858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:51.075116 (+ 258us) server_negotiation.cc:407] Connection header received
0808 07:11:51.075171 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:51.075172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:51.075185 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:51.075235 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:51.075404 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:51.076131 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:51.077196 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:51.077397 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:51.077477 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:51.077628 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:51.077665 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:51.077722 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:51.077882 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 07:11:51.077908 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:11:51.078145 1261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:51.074569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35520 (local address 127.9.94.61:35337)
0808 07:11:51.074615 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:51.074617 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:51.074879 (+ 262us) server_negotiation.cc:407] Connection header received
0808 07:11:51.075013 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:51.075014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:51.075026 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:51.075082 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:51.075213 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:51.075788 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:51.077065 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:51.077396 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:51.077496 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:51.077862 (+ 366us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:51.077897 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:51.077947 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:51.078035 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 07:11:51.078062 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:11:51.078449 1274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:11:51.074523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37306 (local address 127.9.94.62:36699)
0808 07:11:51.074785 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 07:11:51.074787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:11:51.074795 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:11:51.074843 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:11:51.074844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:11:51.074901 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:11:51.074982 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:11:51.075255 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:51.076046 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:51.076894 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:11:51.077333 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:11:51.077649 (+ 316us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:11:51.077908 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:11:51.078042 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:11:51.078300 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 07:11:51.078330 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 07:11:51.078355 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":73,"threads_started":1}
I20260808 07:11:51.080786 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 878
I20260808 07:11:51.088898 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 958
I20260808 07:11:51.095741 9592 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskfmG05D/build/release/bin/kudu with pid 1039
2026-08-08T07:11:51Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3135 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6264 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (297271 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST